Brian Hendriks

March 2, 2020

The National Oceanic and Atmospheric Administration, NOAA, publishes weather measurements taken from stations around the world. It started in 1901 with a handful of stations, and there are more than 35,000 stations today. Most of these stations…

Zach Musgrave

February 28, 2020

Dolt is Git for data. We built Dolt to help teams collaborate on data sets using the forking, branching, and merging workflows that Git popularized. These workflows are what enable software engineers to collaborate on source code, and they...

Oscar Batori

February 26, 2020

In our previous blog post we examined some freely available licensing tools for open data from Creative Commons. To briefly recap a license specifies the terms under which copyrightable material is made available for public access, sharply dis...

Oscar Batori

February 24, 2020

Introduction Dolt is a data format. DoltHub is a collaboration platform for data stored in the Dolt format. When sharing copyrighted content the terms of that sharing are governed by a license. In this post we highlight some common licen...

Tim Sehn

February 23, 2020

John Hopkins University Center for Systems Science and Engineering began collecting, tabulating, and publishing Novel Coronavirus (COVID-19) data on January 31, 2020. We started importing this dataset into Dolt on February 5, 2020. This blo...

Matt Jesuele

February 20, 2020

Towards the end of last month, we launched a totally reworked and redesigned version of DoltHub , our web application for hosting and collaborating on Dolt repositories. Now that we've had a little while to iron the kinks out, it seems like...

Oscar Batori

February 17, 2020

Background We are excited to announce the launch of our documentation site . The goal of Dolt and DoltHub is to enable developers and the data community with radically better data infrastructure. High quality documentation should empo...

Zach Musgrave

February 14, 2020

Happy Valentines Day from all of us at DoltHub ! You are the reason we do what we do! In honor of the holiday, we want to talk about how much we love making queries faster. We're going to examine how our...

Katie McCulloch

February 13, 2020

Dolt and DoltHub strive to be the best data distribution platform on the internet. Having documentation versioned alongside data, and a standard, easy way to read the documentation online are features we admire in Git and GitHub. Following ...

Aaron Son

February 10, 2020

Dolt is a SQL database with Git-style versioning and distribution. The most recent releases of Dolt introduced support for SQL views that are stored as part of, and versioned along with, a Dolt repository. This provides a great way for data sets ...

Brian Hendriks

February 3, 2020

In a previous blog I showed how the history of a dataset can be queried using the dolt history tables, and in the first part of this 2 part blog I covered the IRS SOI data . In this second part I use the IRS SOI data along with doltpy ...

Tim Sehn

February 3, 2020

Dolt is a SQL database with Git-style versioning. In Git the unit of versioning is files. In Dolt, the unit of versioning is SQL tables. Dolt will eventually support 100% of the Git command line and 100% of MySQL SQL. Moreover, anything you can d...

Brian Hendriks

January 31, 2020

Every year the IRS publishes a treasure trove of data. It contains over a hundred different metrics which provide insight into the finances of American taxpayers. Even more compelling is they provide this information at ZIP code granularity, which…...

Andy Arthur

January 29, 2020

Since its launch in 2008, GitHub has catalyzed the open source software world and accelerated the culture of software collaboration. Source control was an old idea at that point, but GitHub offered a centralized place to discover and collaborate...

Brian Hendriks

January 23, 2020

When we started developing Dolt our vision was to deliver git functionality for data. Where git versions files, Dolt versions tables. We implemented table based diff and conflict logic and shipped the initial version. As we started to use Do...

Oscar Batori

January 22, 2020

Redesigning DoltHub Dolt is a database and a data format. DoltHub is a way of hosting and collaborating on Dolt databases. We decided to redesign DoltHub to make it more user friendly. We are excited to announce that we have released the resu...

Zach Musgrave

December 17, 2019

A few months ago we finally settled on a good way to measure the correctness of Dolt's SQL engine: the sqllogictest package, first developed for SQLite and since used as a benchmark for lots of other database implementations. SQLite hit u...

Tim Sehn

December 6, 2019

IBM and General Electric invented the first databases in the early 1960s. It was only by the early 1970s that enough data had accumulated in databases that the need to transfer data between databases emerged. Enter the Comma Separated Values (CSV…

Taylor Bantle

December 4, 2019

Wikipedia is the largest and most popular general reference work on the internet, making it a powerful tool for predictive language modeling. Wikipedia releases a dump of all its articles and pages twice a month, and we created a dataset of...

Zach Musgrave

November 19, 2019

Since releasing Dolt , we have often been asked how it scales. How many rows and how many gigs can you get into a Dolt dataset before things start breaking badly? Answering this question in practice is kind of difficult, simply because it'...