Skip to content

Data Version Control

This topic describes data science version control in MissingLink for managing the versions of your data volumes.

When working with datasets, you might need to check out a specific, earlier data volume version, especially when modifications to a dataset did not produce the desirable results.

Creating and committing versions of your data volumes helps you to achieve that.

Each data volume version is immutable and if you want to change the dataset, you have to commit a new version.

When you perform a regular sync to the data volume, that is, without explicitly committing it, you create a staging version of the data. The data is shown in the dashboard under the data volume and marked Staging. You can then later commit it as a new version.

Note

Unless otherwise specified, the default version that MissingLink references in each case is the staging version.

Committing a staged version

You can commit a version either by using the MissingLink dashboard, or by running a command from the CLI.

  1. Inside the Staging area, click Commit.

    Step 1

  2. Provide a description for the commit and click Commit.

    Step 2

    The new commit is added to the list of versions.

    Step 2

Run the ml data commit command:

ml data commit yourDataVolumeID --message "your commit message"

A new commit is added to the web dashboard under the data volume.

You can also achieve the commit by running the ml data sync command with the --commit flag:

ml data sync yourDataVolumeID --data-path yourDataPath --commit "your commit message"

For a complete description of the commands and the available flags, see the commit and sync commands in the CLI reference.

Note

Note that the commit takes all uncommitted changes into the same version and not only the changes in the sync command.

You can unstage a version that has been staged, but not yet committed.

  1. Inside the Staging area, click Unstage.

    Step 1

  2. Approve that you want to unstage your changes. __ !!! note In the case of an unstage, all of your unstaged data will be lost.

    Step 2