Announcing DoltHub Jobs and DoltLab v0.6.0

FEATURE RELEASEWEBDOLTLAB
3 min read

Today we're excited to make two announcements, one for each of our web based platforms, DoltHub and DoltLab. For DoltHub, "Jobs", our term for long running asynchronous work, are now supported.

Jobs can be kicked off by DoltHub users, or may be kicked off on a user's behalf, and then can be monitored until they complete. We've recently transitioned DoltHub's file upload process to run as a Job, substantially boosting the size of file uploads that DoltHub can support.

For DoltLab, we're excited to announce the release of DoltLab v0.6.0 that adds some great new DoltHub features, like the new ER diagrams, and supports Dolt's new storage format.

Before we jump into any more details, if you're unfamiliar with either of these products, DoltHub is the place on the internet for sharing and collaborating on Dolt databases using a GitHub style workflow. DoltHub lets users seamlessly create pull requests, merge branches, and file issues for any of their databases.

DoltLab, like GitLab, is the self-hosted version of DoltHub. DoltLab is the product of choice for enterprise customers looking to integrate Dolt into their company's stack, but don't want to push their data to the public internet.

DoltHub Jobs

DoltHub Jobs can be viewed on the database page in the "Jobs" tab. If you've created or triggered any Jobs, you can find them listed here along with their current status.

Currently, the only Job supported on DoltHub is an Import Job, created when you upload a file, or use the database spreadsheet editor. Check out the gif below to see this new flow in action.

DoltHub import job flow

After uploading your file, you will be redirected to the Jobs tab where you can see the status of your new Job.

Once your job succeeds, you'll be linked to a pull request containing the changes from the file. From there, you can simply merge the pull request to have your changes committed on your main branch.

Prior to Jobs, DoltHub only supported CSV file uploads up to 270 MBs and SQL file uploads up to 10 MBs. Now, DoltHub supports SQL file uploads up to 200 MBs, and CSV uploads up to 1 GB! And, we're actively working to increase these limits in the near future.

For those of you excited to start using Dolt's new storage format for an older DoltHub database, we'll be adding our next DoltHub Job, Migrate, in the coming weeks. This will allow you to simply click a button and have your old format databases migrated to the new storage format, automatically.

We're also working to add Merge Jobs, too. Timeouts on long running merges will soon be a thing of the past. Stay tuned for updates as we continue to add DoltHub Jobs and improve the DoltHub user experience!

DoltLab v0.6.0

To all the DoltLabbers out there, v0.6.0 is available now! As mentioned above, this release contains some great new DoltHub features and supports Dolt's new storage format __DOLT__.

This is not a breaking change for DoltLab, but its important to note that new databases created on DoltLab ^v0.6.0 will use the __DOLT__ format as default. Databases using this format can be identified with the new format badge, as in the image below, located to the right of Admin:

DoltLab new format badge

Along with DoltLab v0.6.0, we also recommend upgrading your Dolt clients to ^v0.5.1, as these clients now initialize new databases with the __DOLT__ format by default.

As far as DoltLab Jobs... the work to support them is currently underway 🤠.

Conclusion

We love getting feedback, questions, and feature requests from our community so if there's anything you'd like to see added in DoltHub, DoltLab or in one of our other products, please don't hesitate to reach out.

You can checkout each of our different product offerings below, to find which ones are right for you:

  • Dolt—it's Git for data.
  • DoltHub—it's GitHub for data.
  • DoltLab—it's GitLab for data.
  • Hosted Dolt—it's RDS for Dolt databases.

Also, don't hesitate to contact us here or on Discord.

SHARE

JOIN THE DATA EVOLUTION

Get started with Dolt

Or join our mailing list to get product updates.