-
Notifications
You must be signed in to change notification settings - Fork 48
/
CHANGES.txt
818 lines (427 loc) · 32.1 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
Apache HCatalog Change Log
Trunk (unreleased changes)
INCOMPATIBLE CHANGES
NEW FEATURES
HCAT-509 Webhcat security work (thejas via gates)
IMPROVEMENTS
OPTIMIZATIONS
BUG FIXES
HCAT-163 NPE when illustrating a relation (daijy)
HCAT-628 Committer deletes the original partition when a duplicate partition fails registration (thiruvel via daijy)
HCAT-554 Loading data using HCatLoader() from a table on non default namenode fails. (amalakar via avandana)
HCAT-629 First request always fails for webhcat (kamrul via gates)
HCAT-639 ant test fails on trunk due to checkstyle issues (gates)
HCAT-640 CHANGES.txt still lists 0.5 as unreleased (gates)
HCAT-625 HCatalog 0.5.0 installation document is outdated (kamrul via gates)
Release 0.5.0 - Released 14 February 2013
INCOMPATIBLE CHANGES
NEW FEATURES
HCAT-546 Rework HCatalog's JMS Notifications (mithunr via gates)
HCAT-364 HCatalog pig adapter should handle boolean fields (traviscrawford)
HCAT-515 Upgrade hadoop23 version to use 0.23.3 (cdrome via toffer)
HCAT-132 Add HCatalog to Maven Repository (traviscrawford)
HCAT-375 Make HCat work for Hadoop 0.23 (cdrome via toffer)
HCAT-469 HiveClientCache may return a closed client (amalakar via toffer)
HCAT-370 Create a HiveMetaStoreClient cache in hcatalog (amalakar via toffer)
HCAT-419 Java APIs for HCatalog DDL commands (avandana via toffer)
HCAT-182 Web services interface for HCatalog access and Pig, Hive, and MR job execution (ctdean, Rachel Gollub, and thejas via gates)
HCAT-328 HCatLoader should report its input size so pig can estimate the number of reducers (traviscrawford via gates)
HCAT-427 Document storage-based authorization (lefty via gates)
IMPROVEMENTS
HCAT-604 add flexibility wrt. location of PID/LOG files (rvs via traviscrawford)
HCAT-602 release notes for hcatalog 0.0.5 (traviscrawford)
HCAT-595 Update hcatalog hive dependency to 0.10.0 (traviscrawford)
HCAT-549 rename webhcat config and shell scripts to use webhcat in the names (thejas via gates)
HCAT-446 Enforce apache headers for all HCatalog code (traviscrawford via gates)
HCAT-564 test.sh should let users specify the ant version (traviscrawford)
HCAT-527 InputJobInfo should not be public (traviscrawford)
HCAT-560 HCatClient should support addition of new columns to a Table.(mithunr via avandana)
HCAT-558 Update test.sh to test from an extracted src-release (traviscrawford)
HCAT-557 add modules to maven pom (toffer)
HCAT-542 Fix 0.23 build and dependencies (traviscrawford)
HCAT-531 HCatContext should be an enum (traviscrawford)
HCAT-530 HCatBaseLoader.getSizeInBytes NPE when partition path is missing (traviscrawford)
HCAT-518 Refactor hcatalog-core as subproject (traviscrawford and toffer)
HCAT-548 Move topic creation in NotificationListener to a separate method (amalakar via avandana)
HCAT-538 HCatalogStorer fails for 100GB of data with dynamic partitioning, number of partition is 300 (amalakar via toffer)
HCAT-532 HiveClientCache shutdown hook should log at debug level (traviscrawford)
HCAT-528 ivysettings.xml does not let you override .m2/repository or ivy.cache.dir setting ([email protected] via traviscrawford)
HCAT-516 HCOF should use less generic parameters (nitay via traviscrawford)
HCAT-525 Remove dead classes from HCatalog Source Tree (amalakar via traviscrawford)
HCAT-521 Ignore .reviewboardrc in git (nitay via traviscrawford)
HCAT-519 Migrate pig-adapter/webhcat to maven dependencies and continue build cleanup (traviscrawford)
HCAT-517 Misc. build cleanup (traviscrawford)
HCAT-506 desired number of input splits for large files (gmalewicz via traviscrawford)
HCAT-461 Refactor server-extensions as a subproject (traviscrawford)
HCAT-500 HCatStorer should honor user-specified path for external tables (pengfeng via traviscrawford)
HCAT-493 Convert classes with 2 space indentation to 4 space indentation for consistent style (amalakar via traviscrawford)
HCAT-489 HCatalog style cleanups and readd javac debug option (traviscrawford)
HCAT-431 document hcat type to java class/pig type mapping (lefty via khorgath)
HCAT-492 Document CTAS workaround for Hive with JSON serde (lefty via khorgath)
HCAT-487 HCatalog should tolerate a user-defined amount of bad records (traviscrawford)
HCAT-488 TestHCatStorer should extend HCatBaseTest so it uses junit4 and runs inside an IDE (traviscrawford)
HCAT-486 HCatalog should use checkstyle to enforce coding style (traviscrawford)
HCAT-484 HCatalog should use ql.metadata Table and Partition classes (traviscrawford)
HCAT-485 Document that storage-based security ignores GRANT/REVOKE statements (lefty via khorgath)
HCAT-442 Documentation needs update for using HCatalog with pig (lefty via gates)
HCAT-482 Document -libjars from HDFS for HCat with MapReduce (lefty via gates)
HCAT-481 Fix CLI usage syntax in doc & revise HCat docset (lefty via khorgath)
HCAT-444 Document reader & writer interfaces (lefty via gates)
HCAT-425 Pig cannot read/write SMALLINT/TINYINT columns (traviscrawford)
HCAT-460 Enable boolean to integer conversions (traviscrawford)
HCAT-450 HCatalog should use transitive ivy dependencies (traviscrawford)
HCAT-350 Writing BINARY data to HCatRecord depends on a Hive class (thejas via traviscrawford)
HCAT-440 pig field names for arrays should be configurable (traviscrawford)
HCAT-434 Package HCatalog pig support as a separate jar (traviscrawford)
HCAT-341 InitializeInput improvements (traviscrawford)
HCAT-439 Unit test failures in trunk build - Jenkins build 1516 (avandana)
HCAT-426 HCatalog should log with slf4j everywhere (traviscrawford via khorgath)
HCAT-389 hcat_ping (script to check if HCatalog server is running/reachable) (mithun via khorgath)
HCAT-432 Add findbugs to build (rohini via avandana)
HCAT-424 Code cleanup of tabs (khorgath)
HCAT-331 Update HCatalog to junit 4 (traviscrawford via khorgath)
HCAT-414 More HCat e2e tests (khorgath via gates)
HCAT-374 Add HCatBaseTest and one example usage (traviscrawford via gates)
HCAT-390 Add e2e test for Hive with different file formats in different partitions (daijy via gates)
HCAT-368 Documentation improvements: doc set & API docs (lefty via gates)
HCAT-387 Trunk should point to 0.10 snapshot to match hive trunk (toffer)
HCAT-329 HCatalog build fails with pig 0.9 (traviscrawford via hashutosh)
HCAT-233 gitignore file (enis via gates)
OPTIMIZATIONS
BUG FIXES
HCAT-614 Environment/rpm based configuration for e2e test do not have hcatcoredevlib defined in it (amalakar via toffer)
HCAT-601 fix hcatalog dependency resolution issues (sushanth via traviscrawford)
HCAT-608 exclude data files from hcatalog release audit report (traviscrawford)
HCAT-606 remove hcatalog test includes/excludes files (traviscrawford)
HCAT-599 NotificationListener doesn't use getTopic() for sending messages. (mithun via traviscrawford)
HCAT-605 HCatalog release script does not update version in build.properties (traviscrawford)
HCAT-603 releaseaudit should run before generating artifacts (traviscrawford)
HCAT-598 fix setting hcatalog version number via the command-line (traviscrawford)
HCAT-600 webhcat installation doc incorrectly gives location of start/stop script (gates)
HCAT-593 webhcat system tests don't work as per the instructions (thejas via gates)
HCAT-596 fix releaseaudit and automate running (traviscrawford)
HCAT-587 webhcat controller map task takes too much memory (thejas via traviscrawford)
HCAT-594 updated documentation, default.xml, job submission fix (thejas via gates)
HCAT-588 Webhcat server wouldn't start as it is unable to write templeton.log (thejas via traviscrawford)
HCAT-573 Remove version number from WEBHCAT_JAR in webhcat_config.sh (thejas via traviscrawford)
HCAT-592 webhcat - handle change in hive table/partition not found error (thejas via gates)
HCAT-586 checkstyle fails every time complaining that it's own header file does not have the proper header (gates)
HCAT-580 Optimizations in HCAT-538 break e2e tests (daijy via gates)
HCAT-583 e2e tests do not build (gates)
HCAT-577 HCatContext causes persistance of undesired jobConf parameters (khorgath via gates)
HCAT-584 Changes in HCAT-538 break Pig stores into non-partitioned tables (gates)
HCAT-576 HCATALOG-527 Broke backward compatibility (gates)
HCAT-567 HCatClient must allow retrieval of multiple partitions using a partial partition spec.(mithun via avandana)
HCAT-556 HCatalog-trunk doesn't build against Hive-0.10.0 (mithun via avandana)
HCAT-566 HCatTable doesn't report partition columns correctly. (mithun via traviscrawford)
HCAT-562 HCatClient should allow for a table's message-topic-name to be queried for. (mithunr via avandana)
HCAT-561 HCatClient should differentiate between "partition not available" and other generic errors.(mithunr via avandana)
HCAT-563 hcat script should look in the correct dir for the storage handler jars (arpitgupta via khorgath)
HCAT-559 Fix trivial build warnings in HCat trunk (mithunr via avandana)
HCAT-555 hcat script should look for hcatalog-core jar and add HCAT_PREFIX/conf as a config location that is checked. (arpitgupta via traviscrawford)
HCAT-534 HCat_Drop_Table_3 dfs mkdir failing on hadoop23 (cdrome via toffer)
HCAT-453 HCatalog queries fail due to exceeding max jobconf size (pengfeng via traviscrawford)
HCAT-523 PigHCatUtil should not assume map key type can be casted to String (pengfeng via traviscrawford)
HCAT-522 Make HCatHadoopShims.commitJob() generic (traviscrawford)
HCAT-451 Partitions are created even when Jobs are aborted (avandana)
HCAT-513 Data Store onto HCatalog table fails for dynamic partitioning as the temporary directory gets deleted by the completed map tasks (amalakar via toffer)
HCAT-497 HCatContext should use the jobconf instead of its own conf (traviscrawford)
HCAT-494 MultiOutputFormat in 0.23 fails to setAliasConf() correctly. (mithun via toffer)
HCAT-507 e2e harness failing on 0.23 (toffer)
HCAT-502 HCatalog dependency resolution fails due to missing repo (traviscrawford)
HCAT-490 HCatStorer() throws error when the same partition key is present in records in more than one tasks running as part of the same job (amalakar via traviscrawford)
HCAT-499 Multiple store commands does not work with Hadoop23 (rohinip via avandana)
HCAT-501 HBase storage handler tests failing in trunk (traviscrawford)
HCAT-498 TestNotificationListener failing in trunk (traviscrawford)
HCAT-397 Removal of unused parameter hadoop.clientside.fs.operations (khorgath via traviscrawford)
HCAT-483 HCatBaseStorer.getHCatFSFromPigFS fails when Table schema is not provided (pengfeng via traviscrawford)
HCAT-477 Drop table API in webhcat client does not respect the "ifExists" parameter.
HCAT-471 Test HCat_ShowDes_1[1-3] fails (vikram.dixit via gates)
HCAT-470 Update HCat version numbers in Templeton doc set (lefty via gates)
HCAT-472 HCatalog should use Deserializer in the read path instead of SerDe (traviscrawford)
HCAT-467 Templeton scripts point to wrong jar name (jghoman via traviscrawford)
HCAT-436 JSON SerDe column misnaming on CTAS (khorgath via gates)
HCAT-449 HCatLoader is mistakenly identifying Configuration parameters to store (cdrome via traviscrawford)
HCAT-456 storage-handlers tests failing due to missing commons-io (traviscrawford)
HCAT-452 HCat_Drop_Table_3 does not get initialized properly (cdrome via toffer)
HCAT-445 Clover builds broken on trunk (aklochkov via traviscrawford)
HCAT-448 HCatStorer performance is 4x slower in HCat 0.4 than HCat 0.2 (rajesh.balamohan via khorgath)
HCAT-447 findbugs target doesn't work in trunk (traviscrawford)
HCAT-437 HCatSchema's equals() implementation uses hashcode obtained from toString() method. (avandana)
HCAT-438 HCatFieldSchema class does not have equals() method implementation (avandana)
HCAT_416 MultiOutputFormat should handle merging of DistributedCache configurations (rohini via avandana)
HCAT-423 HCatalog should include SerDe-reported fields in the table schema (traviscrawford via khorgath)
HCAT-362 add --local-infile to the mysql command (arpitgupta via daijy)
HCAT-417 List Ant 1.8 in install pre-reqs (jghoman via daijy)
HCAT-422 missing guava lib in trunk build causes unit test failures
HCAT-406 The "toString" method in HCatFieldSchema class return only type information. (avandana)
HCAT-421 Unit test failures in trunk build (avandana)
HCAT-411 Incorrect example provided in the HCatalog documentation (Overview page) avandana
HCAT-355 Include 1.1.0 version of hadoop as test dependency to fix random test failures in build (rohini via avandana)
HCAT-409 MultiOutputformat should make getJobContext public (rohini via avandana)
HCAT-403 MultiOutputFormat will call taskCommit on all formats if only one ever needs commit (rohini via avandana)
HCAT-400 HCatalog build fails from git checkout due to missing lib directory (traviscrawford via gates)
Release 0.4.0 - Release May 16 2012
INCOMPATIBLE CHANGES
HCAT-304 Remove hcat.hbase.column.mapping table property (rohini via gates)
HCAT-358 Remove externed hive code from HCat code and use maven instead (thw and gates via gates)
HCAT-359 hcatalog tar.gz should only have hcatalog binaries (gkesavan via gates)
HCAT-267 rename 64 bit rpm/deb package (gkesavan via gates)
HCAT-289 InputJobInfo still uses serverUri and serverKerberosPrincipal (khorgath via gates)
HCAT-295 Rename storage-drivers directory to storage-handlers (gates)
HCAT-264 Barrier for HCatOutputFormat for Pig/Mapreduce if the table contains feature only supported in Hive (daijy via gates)
HCAT-279 Remove remaining code mentioning isd/osd (daijy via gates)
HCAT-261 Enable more DDL statements for HCat (daijy via gates)
HCAT-252 Rework HBase storage driver into HBase storage handler (rohini via toffer)
HCAT-265 remove deprecated HCatStorageHandler (toffer)
HCAT-239. Changes to HCatInputFormat to make it use SerDes instead of StorageDrivers (vikram.dixit via gates)
HCAT-245. StorageHandler authorization providers (enis via hashutosh)
HCAT-241. Changes to HCatRecord to support switch from StorageDriver to SerDe (khorgath)
HCAT-240. Changes to HCatOutputFormat to make it use SerDes instead of StorageDriver (toffer)
NEW FEATURES
HCAT-36 Support Writing Out to Multiple Tables in HCatOutputFormat (rohini via toffer)
HCAT-342 enable hcat to work with hive bigtop rpm (thejas via gates)
HCAT-287 Add data api to HCatalog (hashutosh)
HCAT-310 Turn current RM implementation into HBase Coprocessor (thw via toffer)
HCAT-334 HCatalog should generate a POM file so it can be deployed to a maven repo (traviscrawford via gates)
HCAT-296 Hcatalog should be able talk to secure hbase server using hbase delegation token (rohini via toffer)
HCAT-249 Rework JSON StorageDriver into a JSON SerDe (khorgath via gates)
HCAT-255 Define hadoop properties on the hcat command line (ctdean via gates)
HCAT-2 Support nested schema conversion between Hive an Pig (julienledem via hashutosh)
IMPROVEMENTS
HCAT-404 add separate configuration for revision manager (toffer)
HCAT-373 ProgressReporter should work with both old and new MR API (traviscrawford via toffer)
HCAT-68 Logging from HCat (avandana via toffer)
HCAT-383 Add clover to build.xml (gates)
HCAT-372 Add filter information to Load/Store and Input/Output docs (lefty via gates)
HCAT-379 Fix mapred.out.dir hack in FileOutputCommitterContainer (toffer)
HCAT-69 Fix token usage from HCat (toffer)
HCAT-352 Need tests for complex types (gates)
HCAT-268 Remove remnants of storage drivers. (rohini via gates)
HCAT-306 Need more end-to-end tests (gates)
HCAT-130 Documentation improvements (gates and lefty via gates)
HCAT-266 Upgrade HBase dependency to 0.92 (thw via toffer)
HCAT-243 HCat e2e tests need to change to not use StorageDrivers (gaets)
HCAT-256 HCatalog should provide its classpath to tools (gates)
HCAT-266 Upgrade HBase dependency to 0.92. (thw via toffer)
HCAT-253 HBase revision manager should configure/drop znodes in the create/drop table meta hooks in the storage handler. (avandana via toffer)
HCAT-259 Make readFields() and write() in LazyHCatRecord work (gates via khorgath)
HCAT-194. Better error messages for HCatalog access control errors (julienledem via hashutosh)
OPTIMIZATIONS
BUG FIXES
HCATALOG-410 support proxy user in hcat client (thejas via daijy)
HCAT-380 If pig script does load then order by, hive-site.xml doesn't seem to propagate properly (toffer)
HCAT-396 src-release leaves out lib directory (gates)
HCAT-393 Several hcat 0.4 document fixes (daijy via gates)
HCAT-395 Hcat 0.4 last minute doc fixes (gates)
HCAT-382 NPE in pig when a binary field is null (rohini vi avandana)
HCAT-386 e2e tests should respect JAVA_HOME when it's set (gates)
HCAT-363 HCat leaks metastore connection (rohini via toffer)
HCAT-314 HCatOutputFormat.setOutput is called more than once by HCatStorer (avandana via toffer)
HCAT-378 Found a few source files missing Apache headers (gates)
HCAT-377 Recent changes broke releaseaudit target (gates)
HCAT-367 Pig writes data but partition information isn't getting updated (rohini via gates)
HCAT-365 HCatUtil.getStorageHandler should set the configuration (traviscrawford via gates)
HCAT-371 A few javadoc warnings have crept into HCat (gates)
HCAT-320 Remove filtering of table properties which are not prefix with "hcat." (rohini via gates)
HCAT-357 e2e harness: allow to run again pre-installed packages (thw via daijy)
HCAT-356 Compilation failure due to API change in HIVE-2908 (rohini via gates)
HCAT-354 hive-hbase-handler jar not getting put in hcat package (gates)
HCAT-348 HCatUtil::getHiveConf(Configuration) ignores passed-in conf while creating HiveConf (gates)
HCAT-312 Hcatalog rpms change the ownership of /usr/lib64 to hcat user (gkesavan via gates)
HCAT-301 Reading from a table created with upper case table name throws error. (rohini via toffer)
HCAT-302 unable to write to hbase channel. HBaseHCatStorageHandler class not found (rohini via gates)
HCAT-335 Release notes issues for 0.4 (gates)
HCAT-338 A couple of typos in the 0.4.0 document (gates)
HCAT-319 Cleanup of 0.3 mapred classes (khorgath via gates)
HCAT-291 Pig and MR fail to write to a sequence file (avandana via gates)
HCAT-305 hcat shell is not properly picking up the hcat jar (gates)
HCAT-307 NOTICE and LICENSE file need updated to add new jars and move copyright date to 2012 (gates)
HCAT-300 A number of files lack Apache license headers (gates)
HCAT-299 Javadoc build issues (gates)
HCAT-303 Fix build failure due to HBaseSerDe.parseColumnMapping method signature change in hive (rohini via toffer)
HCAT-282 HCatInputFormat shouldn't expect storageHandler to be serializable (khorgath via gates)
HCAT-281 HCat use table schema instead of partition schema to read partition data (daijy and khorgath via gates)
HCAT-286 NPE in HdfsAuthorizationProvider (enis via gates)
HCAT-290 Changes in HBase maven objects breaks hcat build (thw via gates)
HCAT-280 part file name prefix with attempxxxx (daijy via gates)
HCAT-275 JSON SerDe issues (khorgath via gates)
HCAT-278 When outputSchema doesn't match table schema wrong columns are returned to the user (gates)
HCAT-276 After merging in HCATALOG-237 related changes Pig scripts with more than one store fail (daijy and mithun via gates)
HCAT-257 e2e harness not working properly after file location change (gates)
HCAT-270 HCatRecord SerDe does not handle List<Map> or List<List> or List<lazy primitive> correctly (khorgath via gates)
HCAT-248 Set execute.setugi conf variable to true by default (hashutosh via gates)
HCAT-254. Fix storage-drives build.xml (hashutosh via khorgath)
Release 0.3.0 - Unreleased
INCOMPATIBLE CHANGES
NEW FEATURES
HCAT-208. mapred HCatInputFormat/HCatOutputFomat changes to make it work from hive (khorgath via gates)
HCAT-207. Changes to current HCat subsystem to allow it to work with hive (khorgath via gates)
HCAT-204. HCatRecord SerDe (khorgath via gates)
HCAT-192. HBase output storage driver integration with zookeeper based revision manager (toffer via hashutosh)
HCAT-191. HBase input storage driver integration with zookeeper based revision manager. (avandana via toffer)
HCAT-193. Snapshot class for HCatalog tables. (avandana via toffer)
HCAT-87. Newly added partition should inherit table properties. (hashutosh at HIVE-2589 via khorgath)
HCAT-189. Zookpeeper based revision manager for HBase Storage Driver (avandana via toffer)
HCAT-145. Add support for binary data type (hashutosh)
HCAT-151. Fixed native table names used for tables stored in non-default DBs in HBaseInputStorageDriver (avandana via toffer)
HCAT-143. Projection pushdown for HBaseInputStorageDriver (avandana via toffer)
HCAT-121. TextStorageOutputDriver for Pig (daijyc via hashutosh)
HCAT-129. HBase Storage Driver Test doesn't use unique test dir for warehouse (toffer via khorgath)
HCAT-109. HBase Storage Handler for HCatalog (avandana via khorgath)
HCAT-119. Output Storage Driver for HBase (Bulk) and HBaseStorageDriver Composite class (toffer via khorgath)
HCAT-75. Input storage driver for HBase (avandana via khorgath)
HCAT-73. Output Storage Driver for HBase (Direct PUTs) (toffer via khorgath)
HCAT-74. ResultConverter for HBase Storage Drivers (avandana via khorgath)
HCAT-89. Support for creating non-native tables (avandana via gates)
HCAT-60. Refactor HCatalog to support non-filebased outputformats (toffer via gates)
HCAT-63. RPM package integration with Hadoop (khorgath via hashutosh)
IMPROVEMENTS
HCAT-238. Absence of msgbus.topic.name should not be deemed as notification-failure. (mithun via gates)
HCAT-246. Exception masked in HCatSplit class (avandana via toffer)
HCAT-211. Update tar ball installation documentation (vikram.dixit via khorgath)
HCAT-219. Adding HBase e2e tests (daijy via toffer)
HCAT-226. HBase storage drivers should load hbase resources (hbase-site, hbase-default) for the user (hashutosh via toffer)
HCAT-223. Include HWI (vikram.dixit via khorgath)
HCAT-166. Making configuration/installation automatable (vikram.dixit via khorgath)
HCAT-179. Make HCatalog compile against Hadoop 0.23 (thw via khorgath)
HCAT-184. Optionally do not generate forrest docs (traviscrawford via hashutosh)
HCAT-187. HCatalog release missing Hive builtins (traviscrawford via hashutosh)
HCAT-186. Downgrade ivy to 2.1.0 (currently 2.2.0) per HIVE-2580 (traviscrawford via hashutosh)
HCAT-10. Shouldn't assume the secure hadoop installation (julienledem via hashutosh)
HCAT-172. End-to-end test framework for HCatalog (daijyc via hashutosh)
HCAT-158. Update HAR support to work with Hadoop 205 (thw via hashutosh)
HCAT-111. Issues with install instructions and release notes in release candidate (gates via hashutosh)
HCAT-103. Update documentation after rpm changes per HCATALOG-63 (khorgath via hashutosh)
HCAT-99. HCatalog V2 Docs (chandec via hashutosh)
HCAT-84. Incorrect or missing SVN property settings (sebb via hashutosh)
HCAT-97. Make test harness work with secure cluster (hashutosh)
HCAT-94. Handle the job tracker tokens properly in har jobs (khorgath via hashutosh)
HCAT-43. hcat.sh does not pick up hcatalog.jar correctly (macyang via hashutosh)
HCAT-91. hcat client not setting the config properly (hashutosh)
HCAT-67. Utilities for system testing (hashutosh)
HCAT-64. Refactor HCatTableInfo, JobInfo and OutputJobInfo (toffer via gates)
HCAT-118. HIVE_CONF_DIR needs to be set to run hive (khorgath)
HCAT-101. storage driver and hbase build scripts (toffer via khorgath)
OPTIMIZATIONS
BUG FIXES
HCAT-254. Fix storage-drives build.xml (hashutosh via khorgath)
HCAT-232. Dynamic Partitioning broken: keys set to HIVE_DEFAULT_PARTITION (mithun via gates)
HCAT-229. bin/hcat should put hcatalog.jar into classpath (daiky via gates)
HCAT-234. bin/hcat need to add hbase-site.xml in classpath (daijy via toffer)
HCAT-212. hcat trunk version should be updated (hashutosh)
HCAT-230. Remove log4j compilation dependencies (enis via hashutosh)
HCAT-227. NPE on HBaseInputStorageDriver when table contains a CF that's never been successfully written to (toffer via hashutosh)
HCAT-224. hcatalog e2e tests have the hive version hard coded we should read that from the hive build.properties (Arpit Gupta via hashutosh)
HCAT-225. Fix trunk compile issue, method signature change in thrift client. (hashutosh via toffer)
HCAT-216. we should source hcat-env.sh in hcat-config before we determine where hadoop is (arpitgupta via khorgath)
HCAT-213. determine HIVE_CONF_DIR in hive-config.sh based on rpm or tar ball installs (arpitgupta via khorgath)
HCAT-214. HCat commandline does not set location for config dir correctly (khorgath)
HCAT-197. data generator for e2e assumes hadoop tarball installation (arpitgupta via khorgath)
HCAT-199. HCatOutputCommitter::cleanupJob() fails : Unable to connect to metastore. (mithun via khorgath)
HCAT-197. data generator for e2e assumes hadoop tarball installation (arpitgupta via hashutosh)
HCAT-202. ant clean target is failing (thw via hashutosh)
HCAT-200. e2e test build.xml does not work with rpms (arpitgupta via khorgath)
HCAT-198. A few issues keep e2e tests from running in an automated environment (gates)
HCAT-197. Data generator for e2e assumes hadoop tarball installation (daijy via khorgath)
HCAT-196. Remove dependency on pig.jar for hcatalog server (daijy via khorgath)
HCAT-195. New storage-drivers directory not picked up in src-release target (gates via khorgath)
HCAT-171. HBaseBulkOutputStorageDriver should work with secured hadoop (toffer via khorgath)
HCAT-170. HBaseBulkOSD fails to launch ImportSequenceFile because of missing jars in dist cache (toffer via khorgath)
HCAT-176. Class not found exception when running TestPigStorageDriver (daijy via khorgath)
HCAT-175. HCat fail to build on trunk (daijy via khorgath)
HCAT-173. Make StorerInfo class public (toffer via khorgath)
HCAT-169. Creating a table with HCatStorageHandler does not correctly store the hcat.isd and hcat.osd names (avandana via toffer)
HCAT-160. HBaseDirectOutputStorageDriver outputVersion isn't consitent within the same MR job (toffer via hashutosh)
HCAT-155. HBase bulkOSD requires value to be Put rather than HCatRecord (toffer via hashutosh)
HCAT-157. HBaseOutputFormat assumes hbase table name is hcat table name (toffer via hashutosh)
HCAT-154. HBase bulkOSD and directOSD return inconsistent path for getOutputLocation() (toffer via hashutosh)
HCAT-124. null pointer execption on 'use no_such_db' (hashutosh)
HCAT-125. HCat doesn't support hive's describe database DDL (hashutosh)
HCAT-159. Build broken by recent Hive changes that move around jar files part-2 (thw via hashutosh)
HCAT-159. Build broken by recent Hive changes that move around jar files (gates)
HCAT-148. Meaningful error message on failure to resolve topic name for partition event (thw via hashutosh)
HCAT-136. Pig storer for export/import does maintain partition order (n_krishna_kumar via khorgath)
HCAT-134. Fix hbase build.xml to not affect root package target (khorgath via hashutosh)
HCAT-133. HCatOutpFormat always pass url as null while trying to create a metastore client (khorgath via hashutosh)
HCAT-117. Harness incorrectly assumes secure mode (khorgath via hashutosh)
HCAT-113. rpm name not properly reflecting the version number (gates via hashutosh)
HCAT-112. install scripts assumes bash shell but don't set it explictly (hashutosh)
HCAT-100. Change references of hcat.sh to hcat in test harness (hashutosh)
HCAT-78. Update notice.txt and headers and add Disclaimer.txt (hashutosh and gates via gates)
HCAT-114. README.txt has duplicate info (ctdean via khorgath)
HCAT-115. Superfluous warning on fresh install (ctdean via khorgath)
Release 0.2.0 - October 2, 2011
INCOMPATIBLE CHANGES
NEW FEATURES
HCAT-42. Storing across partitions(Dynamic Partitioning) from HCatStorer/HCatOutputFormat (khorgath)
HCAT-46. Send a message on a message bus when a partition is marked done (hashutosh via macyang)
HCAT-2. Send a message on a message bus when events occur in Metastore (hashutosh)
HCAT-16. Add InputFormat/OutputFormat for handling exported tables/partitions.
(Krishna Kumar via macyang)
IMPROVEMENTS
HCAT-153. More comprehensive documentation for notification
HCAT-150. Updated documentation specifying the need to call HCatOutputFormat.setSchema() (chandec via toffer)
HCAT-107. Better documentation for "hive.metastore.warehouse.dir" config (chandec via toffer)
HCAT-66. HCatalog 0.2.0 Documentation (chandec via hashutosh)
HCAT-54. Javadoc is not being built as part of HCatalog docs (hashutosh)
HCAT-35. HCatalog fails to compile with Pig 0.9 (hashutosh)
HCAT-47. Topic prefix for the message bus should be configurable (hashutosh)
HCAT-39. Lazily create connection for Message bus (hashutosh)
HCAT-44. Add a releaseaudit target to build.xml (gates)
HCAT-40. Remove dependencies from the HCatalog client jar (macyang)
HCAT-37. Misc. build.xml changes (macyang via hashutosh)
HCAT-27. Start and stop scripts for the server (gates)
HCAT-21. Install documenation and script (gates)
HCAT-34. Add ant target for server side classes (hashutosh)
HCAT-33. minor changes to the test target in build.xml (macyang via hashutosh)
HCAT-30. Need changes.txt (Jakob Homan via hashutosh)
HCAT-19. Enable and add decorators for the export/import cli commands
for authorization and permission setting. (Krishna Kumar via macyang)
HCAT-18. Refactor TestRCFileInputStorageDriver. (Jakob Homan via hashutosh)
OPTIMIZATIONS
BUG FIXES
HCAT-110. Fix source target (khorgath via hashutosh)
HCAT-53. HCatLoader, HCatStorer, HCatInputFormat, and HCatOutputFormat assume Hadoop
running in secure mode (hashutosh)
HCAT-57. Remove usage of deprecated methods (hashutosh)
HCAT-59. Assimilate new changes in listener interface (hashutosh)
HCAT-55. HCatalog distribution missing a few required jars (gates)
HCAT-52. No message is sent on message bus in case partition keys are uppercase (hashutosh)
HCAT-45. HCatalog release tar ball source code has problems (gates)
HCAT-41. Changes to hcat.sh in HCATALOG-20 broke the -e option (gates)
HCAT-12. Get trunk to build. (hashutosh)
HCAT-17. Shouldn't be able to add an HCatFieldSchema with the same name as
existing field. (Jakob Homan via gates)
HCAT-28. Trunk test not compiling: Upstream Hive changes broke TestPermsGrp.
(Jakob Homan via hashutosh)
HCAT-15. Replace all occurrences of 'howl' with hcat/hcatalog.
(Jakob Homan via macyang)
Release 0.1 - Never released
INCOMPATIBLE CHANGES
NEW FEATURES
HCAT-1. Upload initial code to HCatalog (gates)
HCAT-4. Get the build working for HCatalog. (gates)
HCAT-9. Get a beginning HCatalog website up. (gates)
IMPROVEMENTS
HCAT-29. Remove Yahoo copyright from documentation (Jakob Homan via hashutosh)
OPTIMIZATIONS
BUG FIXES
HCAT-7. Ivy fetch of CDH Hadoop versions does not work properly. (gates)
HCAT-6. Unit test TestPermsInheritance fails. (hashutosh)