forked from memsql/singlestore-spark-connector
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGELOG
56 lines (43 loc) · 2.54 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
2019-02-27 Version 2.0.7
* Add support for EXPLAIN JSON in MemSQL versions 6.7 and later to fix partition pushdown.
2018-09-14 Version 2.0.6
* Force utf-8 encoding when loading data into MemSQL
2018-01-18 Version 2.0.5
* Explicitly sort MemSQLRDD partitions due to MemSQL 6.0 no longer returning partitions in sorted order by ordinal.
2017-08-31 Version 2.0.4
* Switch threads in LoadDataStrategy so that the parent thread reads from the RDD and the new thread writes
to MemSQL so that Spark has access to the thread-local variables it expects
2017-07-19 Version 2.0.3
* Handle special characters column names in query
* Add option to enable jdbc connector to stream result sets row-by-row
* Fix groupby queries incorrectly pushed down to leaves
* Add option to write to master aggregator only
* Add support for reading MemSQL columns of type unsigned bigint and unsigned int
2017-04-17
* Pull MemSQL configuration from runtime configuration in sparkSession.conf instead of static config in sparkContext
* Fix connection pooling bug where extraneous connections were created
* Add MemSQL configuration to disable partition pushdown
2017-02-06 Version 2.0.1
* Fixed bug to enable partition pushdown for MemSQL DataFrames loaded from a custom user query
2017-02-01 Version 2.0.0
* Compatible with Apache Spark 2.0.0+
* Removed experimental strategy SQL pushdown to instead use the more stable Data Sources API for reading
data from MemSQL
* Removed memsql-spark-interface, memsql-etl
2015-12-15 Version 1.2.1
* Python support for extractors and transformers
* More extensive SQL pushdown for DataFrame operations
* Use DataFrames as common interface between extractor, transformer, and loader
* Rewrite connectorLib internals to support SparkSQL relation provider API
* Remove RDD.saveToMemSQL
2015-11-19 Version 1.1.1
* Set JDBC login timeout to 10 seconds
2015-11-02 Version 1.1.0
* Available on Maven Central Repository
* More events for batches
* Deprecated the old Kafka extractor and replaced it with a new one that takes in a Zookeeper quorum address
* Added a new field to pipeline API responses indicating whether or not a pipeline is currently running
* Renamed projects: memsqlsparkinterface -> memsql-spark-interface, memsqletl -> memsql-etl, memsqlrdd -> memsql-connector.
* Robustness and bug fixes
2015-09-24 Version 1.0.0
* Initial release of MemSQL Streamliner