Drunken Data Quality 1.3.0

• ScalaDoc
• satisfies for simple Column based constraints
• satisfies for conditional Column based constraints

Drunken Data Quality 1.2.0

Checks

• Check if each value in a column is one of the specified ones
• Check if all values in a column satisfy a given regular expression
• Check if all values in a column are convertible to Boolean
• Check if two tables joined on the given columns yield results

Usability

• SQLContext and HiveContext support (create check object from table and database name)
• Show the number of rows of a checked data frame

Drunken Data Quality 1.1.0

New Checks

• Null checks
• String conversion checks
• Foreign key checks

Performance

• Unpersist data frame after checks have run

Fixes

• Failure message of satisfies showed the wrong row number
• Renamed hasKey to hasUniqueKey to avoid confusion with hasForeignKey

Drunken Data Quality 1.0.0

Checks

• number of rows
• generic column constraints using SQL syntax
• key constraint (unique)