Skip to content

Commit

Permalink
Add exact deduplication feature and update examples
Browse files Browse the repository at this point in the history
  • Loading branch information
olivermolenschot committed Nov 19, 2024
1 parent 4423403 commit 0c3ebbc
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions tests/test_exact_deduplication.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
"""
test module for the axolotl.utils.data module
"""
Test suite for functions in the axolotl.utils.data.utils module, focusing on the deduplicate_and_log_datasets function.
Additionally, this test suite includes tests for functions that indirectly call deduplicate_and_log_datasets during the execution of the preprocess command.
"""
# pylint: disable=duplicate-code
# import logging
import unittest

Expand Down

0 comments on commit 0c3ebbc

Please sign in to comment.