Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge release-0.1.2 into main #21

Merged
merged 387 commits into from
Oct 24, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
387 commits
Select commit Hold shift + click to select a range
8acf170
Fix row cache falsely return kNotFound when timestamp enabled (#11816)
Sep 20, 2023
089070c
Expose more info about input files in `CompactionFilter::Context` (#1…
hx235 Sep 20, 2023
c1a97fe
Fix Assertion `roundup_len2 >= alignment' failed in crash tests (#11852)
akankshamahajan15 Sep 20, 2023
548aabf
Disable compressed secondary cache if capacity is 0 (#11863)
anand1976 Sep 21, 2023
bf488c3
Use *next_sequence -1 here (#11861)
thatsafunnyname Sep 21, 2023
32fc1e6
Add unit test for the multiget fix when ReadOptions.read_tier == kPer…
jowlyzhang Sep 21, 2023
b927ba5
Rollback other pending memtable flushes when a flush fails (#11865)
cbi42 Sep 21, 2023
269478e
Support compressed and local flash secondary cache stacking (#11812)
anand1976 Sep 22, 2023
f6cb763
Fix major performance bug in AutoHCC growth phase (#11871)
pdillinger Sep 22, 2023
12d9386
Return a special OK status when the number of merge operands exceeds …
ltamasi Sep 22, 2023
6afde14
Add changelog entry for wide-column full merge (#11874)
ltamasi Sep 22, 2023
77a1d6e
Fix assertion failure in AutoHCC (#11877)
pdillinger Sep 22, 2023
0086809
Fix a bug with atomic_flush that causes DB to stuck after a flush fai…
cbi42 Sep 22, 2023
552bc01
Surface timestamp from db to the transaction iterator (#11847)
jowlyzhang Sep 23, 2023
48589b9
Fix updating the capacity of a tiered cache (#11873)
anand1976 Sep 23, 2023
3d67b5e
Lookup ahead in block cache ahead to tune Readaheadsize (#11860)
akankshamahajan15 Sep 23, 2023
49da91e
Update files for version 8.8 (#11878)
cbi42 Sep 23, 2023
bd655b9
Disable AutoReadaheadSize in stress tests (#11883)
akankshamahajan15 Sep 25, 2023
1c871a4
Only flush after recovery for retryable IOError (#11880)
cbi42 Sep 25, 2023
6c564e2
Add some convenience util APIs to facilitate using U64Ts (#11888)
jowlyzhang Sep 26, 2023
7ea6e72
Mark recovery_in_prog_ to false whenever recovery thread joins (#11890)
jowlyzhang Sep 26, 2023
719f551
No file system prefetching when Options::compaction_readahead_size is…
hx235 Sep 26, 2023
fce0458
Only fallback to RocksDB internal prefetching on unsupported FS prefe…
hx235 Sep 27, 2023
35a0250
Don't call InsertSaved on compressed only secondary cache (#11889)
anand1976 Sep 27, 2023
6b4315e
Extend the test coverage of FullMergeV3 (#11896)
ltamasi Sep 27, 2023
8b56696
remove unnecessary autodeps suppression tag from rocksdb/src (#11904)
Sep 28, 2023
01e2d33
Add the wide-column aware merge API to the stress tests (#11906)
ltamasi Sep 29, 2023
2cfe53e
Add helpful message for ldb when unknown option found (#11907)
jaykorean Sep 29, 2023
02443dd
Refactor, clean up, fixes, and more testing for SeqnoToTimeMapping (#…
pdillinger Sep 29, 2023
63ed868
Offpeak in db option (#11893)
jaykorean Sep 29, 2023
3c4cc6c
flip default `DBOptions::fail_if_options_file_error` (#11800)
ajkr Sep 29, 2023
d98a9cf
test: WritableFile derived class: add missing GetFileSize() override …
rockeet Sep 29, 2023
be879cc
stress test verification value mismatch message (#11912)
ajkr Oct 2, 2023
7bebd30
Update tiered storage tests (ahead of next change) (#11917)
pdillinger Oct 2, 2023
b00fa55
Fix the handling of wide-column base values in the max_successive_mer…
ltamasi Oct 2, 2023
10fd05e
Give retry flushes their own functions (#11903)
ajkr Oct 2, 2023
5fbea87
Disallow start_time == end_time in offpeak time and compare at minute…
jaykorean Oct 2, 2023
97f6f47
Fix various failures in auto_readahead_size (#11884)
akankshamahajan15 Oct 3, 2023
c13569e
RocksDB now requires gflags v2.2.0 (#10933)
adamretter Oct 3, 2023
40b618f
Enable auto_readahead_size in db_stress (#11916)
akankshamahajan15 Oct 3, 2023
141b872
Improve efficiency of create_missing_column_families, light refactor …
pdillinger Oct 4, 2023
8e94911
Fix comments about creation_time/oldest_ancester_time/oldest_key_time…
hx235 Oct 4, 2023
1d5bddb
Bootstrap, pre-populate seqno_to_time_mapping (#11922)
pdillinger Oct 6, 2023
2dc63c8
Add the default WritableFile::GetFileSize implementation back for com…
jowlyzhang Oct 6, 2023
21a1236
Add EXPERIMENTAL comments about XXOptions::io_activity (#11926)
hx235 Oct 6, 2023
51d7e6a
Clean up WriteBatchWithIndexInternal a bit (#11930)
ltamasi Oct 9, 2023
229a6e5
Remove unnecessary comments (#11833)
darionyaphet Oct 10, 2023
ee0829b
fix typo snapshto (#11817)
darionyaphet Oct 10, 2023
8a9cfd5
Make stopped writes block on recovery (#11879)
ajkr Oct 10, 2023
77d160e
Consolidate `ErrorHandler`'s recovery status variables (#11937)
ajkr Oct 10, 2023
f1aa17c
Lazy load java native library (#11919)
rhubner Oct 10, 2023
98ab2d8
Add PerfContext API in Java (#11805)
rhubner Oct 10, 2023
5b11f5a
Add TieredCache and compressed cache capacity change to db_stress (#1…
anand1976 Oct 10, 2023
4bd5aa4
Fix two `ErrorHandler` race conditions (#11939)
ajkr Oct 11, 2023
20b4f13
Enable write fault injection in db_stress (#11924)
anand1976 Oct 11, 2023
5e2906c
Add missing copyright headers to files added in PR 11805 (#11942)
ltamasi Oct 11, 2023
d367b34
Fix TSAN crash test false positive (#11941)
anand1976 Oct 11, 2023
d2daa10
Fix crash_test_with_best_efforts_recovery (#11938)
jaykorean Oct 11, 2023
b2fe148
java API - load block based table config (#10826)
alanpaxton Oct 12, 2023
d010b02
Fix race in options taking effect (#11929)
pdillinger Oct 12, 2023
90e1607
Fix runtime error in UpdateTieredCache due to integer underflow (#11949)
anand1976 Oct 12, 2023
648fe25
Always clear files marked for compaction in `ComputeCompactionScore()…
cbi42 Oct 12, 2023
261e9be
Resolve BaseDeltaIterator's value in UpdateCurrent (#11947)
ltamasi Oct 12, 2023
6e3429b
Fix data race in accessing `recovery_in_prog_` (#11950)
cbi42 Oct 12, 2023
dc576af
AutoHCC - fix a rare loop condition in Lookup (#11948)
pdillinger Oct 13, 2023
c9d8e6a
AttributeGroups - MultiGetEntity Implementation (#11925)
jaykorean Oct 13, 2023
50b0879
Do not fail stress test when file ingestion return injected error (#1…
cbi42 Oct 14, 2023
f3aef8c
Add write operation to tracer only after successful callback (#11954)
cbi42 Oct 14, 2023
9ded9f7
Fix db_stress FaultInjectionTestFS set up before DB open (#11958)
cbi42 Oct 14, 2023
2fd850c
Remove write queue synchronization from WriteOptionsFile (#11951)
pdillinger Oct 16, 2023
25d4379
Make rate limiter single burst bytes runtime changeable (#11923)
hx235 Oct 16, 2023
018eede
Remove assertion from PrefetchAsync (#11965)
akankshamahajan15 Oct 16, 2023
84af7cf
Sanitize db_stress arguments when secondary_cache_uri is not empty (#…
anand1976 Oct 17, 2023
2296c62
Perform java static checks in CI (#11221)
alanpaxton Oct 17, 2023
9135a61
Fix corruption error in stress test for auto_readahead_size enabled (…
akankshamahajan15 Oct 17, 2023
933ee29
Fix a race condition between recovery and backup (#11955)
jowlyzhang Oct 17, 2023
4226693
Remove documentation that marks user-defined timestamps feature as ex…
jowlyzhang Oct 17, 2023
d5bc30b
Enforce status checking after Valid() returns false for IteratorWrapp…
cbi42 Oct 18, 2023
0bb3a26
Lazy load native library in Statistics constructor. (#11953)
rhubner Oct 18, 2023
a80e3f6
Add keyExists Java API (#11705)
rhubner Oct 18, 2023
5559001
Add RocksJava tests to CMake (#11756)
rhubner Oct 18, 2023
0836a2b
New tickers on deletion compactions grouped by reasons (#11957)
hx235 Oct 19, 2023
2e514e4
Fix copyright header (#11986)
jaykorean Oct 19, 2023
ef0c3f0
Fix rare destructor bug in AutoHCC (#11988)
pdillinger Oct 19, 2023
d7567d5
Update libs for RocksJava Static build (#9304)
adamretter Oct 20, 2023
543191f
Add bounds checking to WBWIIteratorImpl and respect bounds of ReadOpt…
ywave620 Oct 20, 2023
4155087
Use manifest to persist pre-allocated seqnos (#11995)
pdillinger Oct 23, 2023
4d9f973
Disable AutoHCC in crash test (#12000)
pdillinger Oct 23, 2023
e81393e
Add some stats to observe the usefulness of scan prefetching (#11981)
anand1976 Oct 23, 2023
519f2a4
Add cache_bench to buck build (#11990)
pdillinger Oct 23, 2023
99b371b
Skip subsequent trace writes after encountering trace write failure (…
hx235 Oct 24, 2023
917fd87
Error out in case of std errors in blackbox test and export file in T…
Oct 24, 2023
ab15d33
Update history, version and format testing for 8.8 (#12004)
hx235 Oct 24, 2023
0ff7665
Fix low priority write may cause crash when it is rate limited (#11932)
caipengbo Oct 24, 2023
dc87847
Fix windows build errors (rdtsc and fnptr) (#12008)
pdillinger Oct 24, 2023
f2c9075
Fix dead loop with kSkipAnyCorruptedRecords mode selected in some cas…
qiuchengxuan Oct 25, 2023
0f14135
Fix race between flush error recovery and db destruction (#12002)
hx235 Oct 25, 2023
8ee009f
Downgrade windows 2019 build to older image. (#12014)
rhubner Oct 25, 2023
52be8f5
Add APIs to query secondary cache capacity and usage for TieredCache …
anand1976 Oct 25, 2023
526f36b
Remove extra semicolon (#12017)
jowlyzhang Oct 26, 2023
e230e4d
Make OffpeakTimeInfo available in VersionSet (#12018)
jaykorean Oct 27, 2023
212b5bf
Deep-copy Options in restored db for stress test to avoid race with S…
hx235 Oct 28, 2023
60df39e
Rate limiting stale sst files' deletion during recovery (#12016)
jowlyzhang Oct 28, 2023
b3fd383
Remove build dependencies for java tests. (#12021)
rhubner Oct 30, 2023
76402c0
Fix incorrect parameters order in env_basic_test.cc (#11997)
acelyc111 Oct 30, 2023
2818a74
Initialize merge operator explicitly in PrepareOptionsForRestoredDB()…
cbi42 Oct 31, 2023
e0c45c1
Fix the ZStd checksum (#12005)
adamretter Oct 31, 2023
0b057a7
Initialize comparator explicitly in PrepareOptionsForRestoredDB() (#1…
jowlyzhang Oct 31, 2023
04225a2
Fix for RecoverFromRetryableBGIOError starting with recovery_in_prog_…
jaykorean Oct 31, 2023
4b013dc
Remove VersionEdit's friends pattern (#12024)
jowlyzhang Nov 1, 2023
8e1adab
add RocksDB#clipColumnFamily to Java API (#11868)
mayuehappy Nov 2, 2023
a429105
Save the correct user comparator name in OPTIONS file (#12037)
jowlyzhang Nov 2, 2023
2648e0a
Fix a bug when ingest plaintable sst file (#11969)
914022466 Nov 2, 2023
8505b26
Fix stress test error message for black/whitebox test to catch failur…
cbi42 Nov 3, 2023
b48480c
Enable `TestIterateAgainstExpected()` in more crash tests (#12040)
cbi42 Nov 3, 2023
19768a9
Add jni Support for API CreateColumnFamilyWithImport (#11646)
mayuehappy Nov 6, 2023
520c64f
Add missing status check in ExternalSstFileIngestionJob and ImportCol…
cbi42 Nov 6, 2023
6979e9d
Create blog post from report on JNI performance work (#11818)
alanpaxton Nov 6, 2023
a399bbc
More fixes and enhancements for cache_bench (#12041)
pdillinger Nov 6, 2023
2dab137
Mark more files for periodic compaction during offpeak (#12031)
jaykorean Nov 6, 2023
0ecfc4f
AttributeGroups - GetEntity Implementation (#11943)
jaykorean Nov 6, 2023
92dc5f3
AutoHCC: fix a bug with "blind" Insert (#12046)
pdillinger Nov 7, 2023
2adef53
AttributeGroups - PutEntity Implementation (#11977)
jaykorean Nov 7, 2023
16ae354
AutoHCC: Improve/fix allocation/detection of grow homes (#12047)
pdillinger Nov 7, 2023
c06309c
Not to print unnecessary commands in Makefile (#11978)
zcxsythenew Nov 7, 2023
c181667
FIX new blog post (JNI performance) Locate images correctly (#12050)
alanpaxton Nov 7, 2023
58f2a29
Expose Options::periodic_compaction_seconds through C API (#12019)
zaidoon1 Nov 7, 2023
9af25a3
Clean up AutoHyperClockTable::PurgeImpl (#12052)
pdillinger Nov 8, 2023
e406c26
Update the API comments of NewRandomRWFile() (#11820)
acelyc111 Nov 8, 2023
65cde19
Safer wrapper for std::atomic, use in HCC (#12051)
pdillinger Nov 8, 2023
f337533
Ensure and clarify how RocksDB calls TablePropertiesCollector's funct…
hx235 Nov 8, 2023
f9b7877
Ensure `target_include_directories()` is called with correct target n…
kasperisager Nov 9, 2023
e90e982
Drop wal record when sequence is illegal (#11985)
Nov 9, 2023
c4c62c2
Support to use environment variable to test customer encryption plugi…
acelyc111 Nov 9, 2023
dfaf4dc
Stubs for piping write time (#12043)
jowlyzhang Nov 9, 2023
73d223c
Add auto_tuned option to RateLimiter C API (#12058)
Nov 10, 2023
5ef92b8
Add rocksdb_options_set_cf_paths (#11151)
yhchiang-sol Nov 10, 2023
c6c683a
Remove the default force behavior for `EnableFileDeletion` API (#12001)
jowlyzhang Nov 10, 2023
0ffc0c7
Allow `TtlMergeOperator` to wrap an unregistered `MergeOperator` (#12…
ajkr Nov 11, 2023
509947c
Quarantine files in a limbo state after a manifest error (#12030)
jowlyzhang Nov 11, 2023
9fb6851
fix(StackableDB): Resume API (#12060)
Nov 13, 2023
b3ffca0
DBImpl::DelayWrite: Remove bad WRITE_STALL histogram (#12067)
rockeet Nov 13, 2023
8b8f6c6
ColumnFamilyHandle Nullcheck in GetEntity and MultiGetEntity (#12057)
jaykorean Nov 13, 2023
e7896f0
Enable unit test `PrecludeLastLevelTest.RangeDelsCauseFileEndpointsTo…
cbi42 Nov 13, 2023
65d71ee
Fix warnings when using API (#12066)
idzm Nov 14, 2023
37064d6
Add encfs plugin link (#12070)
acelyc111 Nov 14, 2023
a660e07
Build RocksDBJava on Windows with Java8. (#12068)
rhubner Nov 14, 2023
2222cae
Make CacheWithSecondaryAdapter reservation accounting more robust (#1…
anand1976 Nov 15, 2023
9202db1
Consider archived WALs for deletion more frequently (#12069)
ajkr Nov 15, 2023
6d10f8d
add WriteBufferManager to c api (#11710)
guswynn Nov 16, 2023
a9bd525
Add Qdrant to USERS.md (#12072)
nccx Nov 16, 2023
2f9ea81
Add HyperClockCache Java API. (#12065)
rhubner Nov 16, 2023
4e58cc6
Check internal key range when compacting from last level to penultima…
cbi42 Nov 17, 2023
7780e98
add write_buffer_manager setter into options and tests in c bindings,…
benoitmeriaux Nov 17, 2023
b059c56
Add missing copyright header (#12076)
cbi42 Nov 19, 2023
39d3347
Fix build on FreeBSD (#11218) (#12078)
rriski Nov 20, 2023
fb5c8c7
Do not compare op_type in `WithinPenultimateLevelOutputRange()` (#12081)
cbi42 Nov 21, 2023
336a74d
Add some asserts in ~CacheWithSecondaryAdapter (#12082)
anand1976 Nov 21, 2023
04cbc77
Add missing license to source files (#12083)
ajkr Nov 21, 2023
d3e015f
Fix compact_files_example (#12084)
songqing Nov 21, 2023
84a54e1
Fix some bugs in index builder and reader for the UDT in memtable onl…
jowlyzhang Nov 21, 2023
ddb7df1
Update HISTORY.md and version.h for 8.9.fb release (#12074)
jaykorean Nov 22, 2023
324453e
Fix rowcache get returning incorrect timestamp (#11952)
cz2h Nov 22, 2023
a140b51
Convert all but one windows job to nightly (#12089)
pdillinger Nov 22, 2023
f6fd4b9
Print stack traces more reliably with concurrency (#12086)
pdillinger Nov 22, 2023
4dd2bb8
Fix stack trace trimming with LLDB (#12101)
pdillinger Nov 27, 2023
6e7701d
Fix JavaDoc of setCompactionReadaheadSize (#12090)
alexanderkiel Nov 27, 2023
4d04138
Add dynamic disabling of compressed cache to db_stress (#12102)
anand1976 Nov 27, 2023
acc078f
Add tiered cache options to db_bench (#12104)
anand1976 Nov 28, 2023
d68f45e
Flush buffered logs when FlushRequest is rescheduled (#12105)
jowlyzhang Nov 29, 2023
a777945
sst_dump support cuckoo table (#12098)
raffertyyu Nov 30, 2023
b760af3
Initial support for wide columns in WriteBatchWithIndex (#11982)
ltamasi Nov 30, 2023
7eca51d
Refactor crash test stderr parsing logic into a function (#12109)
jowlyzhang Dec 1, 2023
be3bc36
internal_repo_rocksdb (-8794174668376270091) (#12114)
ajkr Dec 1, 2023
06dc32e
internal_repo_rocksdb (435146444452818992) (#12115)
ajkr Dec 1, 2023
dce3ca5
Remove extra semi colon from internal_repo_rocksdb/repo/monitoring/pe…
r-barnes Dec 2, 2023
ba8fa0f
internal_repo_rocksdb (4372117296613874540) (#12117)
jowlyzhang Dec 4, 2023
2045fe4
Mention PR 11892 in the changelog (#12118)
ltamasi Dec 4, 2023
0ebe161
Eliminate some code duplication in MergeHelper (#12121)
ltamasi Dec 5, 2023
c77b50a
Add AsyncIO support for tuning readahead_size by block cache lookup (…
akankshamahajan15 Dec 6, 2023
179d2c7
Intensify "xxx_one_in"'s default value in crash test (#12127)
hx235 Dec 8, 2023
a143f93
Turn the default Timer in PeriodicTaskScheduler into a leaky Meyers s…
ltamasi Dec 8, 2023
44fd914
Fix double counting of BYTES_WRITTEN ticker (#12111)
kevinmingtarja Dec 9, 2023
4f04f96
Remove extra semi colon from infrasec/authorization/audit/AclAuditor.cpp
r-barnes Dec 9, 2023
5a063ec
Java API consistency between RocksDB.put() , .merge() and Transaction…
alanpaxton Dec 11, 2023
5c5e018
Fix JNI lazy load regression. (#12133)
rhubner Dec 11, 2023
c96d9a0
Allow TablePropertiesCollectorFactory to return null collector (#12129)
pdillinger Dec 11, 2023
c1b84d0
Fix false negative in TieredSecondaryCache nvm cache lookup (#12134)
anand1976 Dec 12, 2023
c2ab4e7
Add initial support to stress test persist_user_defined_timestamps (#…
jowlyzhang Dec 12, 2023
ebb5242
Sanitize the secondary_cache option in TieredCacheOptions (#12137)
anand1976 Dec 12, 2023
d8e4762
Speedup based on pending compaction bytes relative to data size (#12130)
ajkr Dec 13, 2023
d926593
Fix stress tests failure for auto_readahead_size (#12131)
akankshamahajan15 Dec 13, 2023
c74531b
Fix a nuisance compiler warning from clang (#12144)
pdillinger Dec 13, 2023
cd21e4e
Some further cleanup in WriteBatchWithIndex::MultiGetFromBatchAndDB (…
ltamasi Dec 14, 2023
e7c6259
Make auto_readahead_size default true (#12080)
akankshamahajan15 Dec 14, 2023
5502f06
Add support for linux-riscv64 (#12139)
luhenry Dec 14, 2023
cd577f6
Fix WRITE_STALL start_time (#12147)
akankshamahajan15 Dec 14, 2023
88bc91f
Cap eviction effort (CPU under stress) in HyperClockCache (#12141)
pdillinger Dec 15, 2023
cc069f2
Add some compressed and tiered secondary cache stats (#12150)
anand1976 Dec 15, 2023
54d6286
Update HISTORY.md for 8.10
ltamasi Dec 15, 2023
39abded
Fix the compactRange with wrong cf handle when ClipColumnFamily (#12219)
mayuehappy Jan 10, 2024
ef430fc
Fix the problem that wrong Key may be passed when using CompactRange …
mayuehappy Feb 5, 2024
5db6ad7
add unit test for compactRangeWithNullBoundaries java api (#12333)
mayuehappy Feb 13, 2024
d606c94
[FLINK-10471] Add Apache Flink specific compaction filter to evict ex…
azagrebin Feb 6, 2019
927b17e
fix(CompactionFilter): avoid expensive `ToString` call when not in De…
robincacou Nov 21, 2022
b58ba05
FRocksDB release guide and helping scripts
Myasuka Aug 9, 2021
6cae002
Add content related to ARM building in the FROCKSDB-RELEASE documenta…
Myasuka Aug 11, 2021
bac6aeb
[FLINK-23756] Update FrocksDB release document with more info
autophagy Aug 16, 2021
174639c
[hotfix] Change the resource request when running CI
Myasuka Dec 5, 2022
c71fb2a
[hotfix] Add docs of how to upload ppc64le artifacts to s3
Myasuka Jan 20, 2023
8fff7bb
[hotfix] Use zlib's fossils page to replace web.archive
Myasuka Dec 3, 2022
971d425
[hotfix] Regenerate TARGETS
rkhachatryan Feb 22, 2024
96705d2
[hotfix] Fix namespaces in flink compaction filter
rkhachatryan Feb 22, 2024
09e645b
[FLINK-23346] Avoid core dump when rethrowing the exception
Zakelly Dec 14, 2023
b162cb4
[FLINK-35577] Fix the broken CI
mayuehappy Jun 17, 2024
ed46268
Fix error for CF smallest and largest keys computation in ImportColum…
Apr 12, 2024
051f508
Fix a corruption bug in `CreateColumnFamilyWithImport()` (#12602)
cbi42 Dec 13, 2023
d313386
Speedup based on pending compaction bytes relative to data size (#12130)
ajkr Dec 13, 2023
a826aff
Detect compaction pressure at lower debt ratios (#12236)
ajkr Jan 16, 2024
69ba29a
Speedup based on number of files marked for compaction (#12306)
ajkr Jan 30, 2024
ee8b7d1
Fix folly build (#12795)
mayuehappy Jul 5, 2024
9a10201
Update pinned folly version (#12801)
ajkr Jun 24, 2024
8fe04d8
Fix bug of newer ingested data assigned with an older seqno (#12257)
hx235 Jan 24, 2024
703d00a
Access SST full file checksum via RocksDB#getLiveFilesMetadata (#11770)
npepinpe Dec 26, 2023
3e4e540
Fix exception on RocksDB.getColumnFamilyMetaData() (#12474)
rhubner Apr 5, 2024
7a76723
[FLINK-35575] Disable PERF_CONTEXT by default in compilation (#76)
mayuehappy Aug 13, 2024
1d531da
[build] Setting up templates for issues and PRs (#1)
Zakelly Mar 6, 2024
eaa8588
[build] Remove buckify output in sanity check (#3)
Zakelly Mar 7, 2024
f10be99
[env] Introduce interface of env_flink (#5)
masteryhx Mar 12, 2024
b8cb45e
[env] Introduce JvmUtils to support global JNIEnv
Mar 12, 2024
0a7f5f1
[env] Introduce interface of env_flink (#7)
masteryhx Mar 12, 2024
5ad02f7
[build] license and READMEs (#9)
Zakelly Mar 12, 2024
d73053f
[build] Add pr-jobs check (#10)
fredia Mar 13, 2024
e1d1083
[env] Fix jvm_util unused parameter error (#14)
ljz2051 Mar 18, 2024
f845fe4
[env] Implement all methods of env_flink (#13)
masteryhx Mar 15, 2024
d749df5
[env] Modify the license (#13)
masteryhx Mar 18, 2024
40bf82a
[env] Support JNI of FlinkEnv (#12)
ljz2051 Mar 21, 2024
a4ada5b
[env]Introduce flink-env test suite (#17)
ljz2051 Mar 29, 2024
ca371b1
[env] Add test cases in flink-env test suite
masteryhx Apr 1, 2024
abe27da
[build] Fix warning about unused parameters
masteryhx Apr 1, 2024
ae7d821
[build] Support releasing forst
masteryhx Apr 6, 2024
ab5912f
[FLINK-35928][build] rename namespace/jni to forst
fredia Sep 26, 2024
44ac6d8
[build] Fix platform-related codes
fredia Sep 26, 2024
fcb3088
[FLINK-35928][build] Rename jclass to forst in portal.h
fredia Sep 26, 2024
3c86325
[FLINK-35928][build] Rename .so to forst
fredia Sep 27, 2024
98f5a1a
[FLINK-35928][build] break when loading library is interrupted
fredia Sep 27, 2024
eef75e6
[FLINK-35928][build] rename forstdbjni to forstjni
fredia Sep 27, 2024
2faec9e
[FLINK-35928][build] Rename jclass to forst in *.cc
fredia Oct 18, 2024
b1015fe
[build] Fix packaging error
Zakelly Oct 23, 2024
fe973c1
Merge from release-0.1.2
Zakelly Oct 24, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
274 changes: 190 additions & 84 deletions .circleci/config.yml

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@ fbcode/
fbcode
buckifier/*.pyc
buckifier/__pycache__
.arcconfig

compile_commands.json
clang-format-diff.py
Expand Down
44 changes: 31 additions & 13 deletions CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -254,7 +254,7 @@ if(CMAKE_SYSTEM_PROCESSOR MATCHES "loongarch64")
endif(CMAKE_SYSTEM_PROCESSOR MATCHES "loongarch64")

set(PORTABLE 0 CACHE STRING "Minimum CPU arch to support, or 0 = current CPU, 1 = baseline CPU")
if(PORTABLE STREQUAL 1)
if(PORTABLE MATCHES "1|ON|YES|TRUE|Y")
# Usually nothing to do; compiler default is typically the most general
if(NOT MSVC)
if(CMAKE_SYSTEM_PROCESSOR MATCHES "^s390x")
Expand All @@ -264,14 +264,7 @@ if(PORTABLE STREQUAL 1)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -march=loongarch64")
endif()
endif()
elseif(PORTABLE MATCHES [^0]+)
# Name of a CPU arch spec or feature set to require
if(MSVC)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:${PORTABLE}")
else()
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -march=${PORTABLE}")
endif()
else()
elseif(PORTABLE MATCHES "0|OFF|NO|FALSE|N")
if(MSVC)
# NOTE: No auto-detection of current CPU, but instead assume some useful
# level of optimization is supported
Expand All @@ -285,6 +278,13 @@ else()
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -march=native")
endif()
endif()
else()
# Name of a CPU arch spec or feature set to require
if(MSVC)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:${PORTABLE}")
else()
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -march=${PORTABLE}")
endif()
endif()

include(CheckCXXSourceCompiles)
Expand Down Expand Up @@ -596,7 +596,7 @@ if(USE_FOLLY)
FMT_INST_PATH)
exec_program(ls ARGS -d ${FOLLY_INST_PATH}/../gflags* OUTPUT_VARIABLE
GFLAGS_INST_PATH)
set(Boost_DIR ${BOOST_INST_PATH}/lib/cmake/Boost-1.78.0)
set(Boost_DIR ${BOOST_INST_PATH}/lib/cmake/Boost-1.83.0)
if(EXISTS ${FMT_INST_PATH}/lib64)
set(fmt_DIR ${FMT_INST_PATH}/lib64/cmake/fmt)
else()
Expand Down Expand Up @@ -632,6 +632,7 @@ set(SOURCES
cache/secondary_cache.cc
cache/secondary_cache_adapter.cc
cache/sharded_cache.cc
cache/tiered_secondary_cache.cc
db/arena_wrapped_db_iter.cc
db/blob/blob_contents.cc
db/blob/blob_fetcher.cc
Expand Down Expand Up @@ -714,6 +715,7 @@ set(SOURCES
db/wal_manager.cc
db/wide/wide_column_serialization.cc
db/wide/wide_columns.cc
db/wide/wide_columns_helper.cc
db/write_batch.cc
db/write_batch_base.cc
db/write_controller.cc
Expand All @@ -725,6 +727,10 @@ set(SOURCES
env/env_encryption.cc
env/file_system.cc
env/file_system_tracer.cc
env/flink/env_flink.cc
env/flink/jvm_util.cc
env/flink/jni_helper.cc
env/flink/env_flink_test_suite.cc
env/fs_remap.cc
env/mock_env.cc
env/unique_id_gen.cc
Expand Down Expand Up @@ -774,6 +780,7 @@ set(SOURCES
options/configurable.cc
options/customizable.cc
options/db_options.cc
options/offpeak_time_info.cc
options/options.cc
options/options_helper.cc
options/options_parser.cc
Expand Down Expand Up @@ -1027,13 +1034,20 @@ if(USE_FOLLY_LITE)
list(APPEND SOURCES
third-party/folly/folly/container/detail/F14Table.cpp
third-party/folly/folly/detail/Futex.cpp
third-party/folly/folly/lang/Exception.cpp
third-party/folly/folly/lang/SafeAssert.cpp
third-party/folly/folly/lang/ToAscii.cpp
third-party/folly/folly/ScopeGuard.cpp
third-party/folly/folly/synchronization/AtomicNotification.cpp
third-party/folly/folly/synchronization/DistributedMutex.cpp
third-party/folly/folly/synchronization/ParkingLot.cpp)
include_directories(${PROJECT_SOURCE_DIR}/third-party/folly)
exec_program(python3 ${PROJECT_SOURCE_DIR}/third-party/folly ARGS
build/fbcode_builder/getdeps.py show-source-dir boost OUTPUT_VARIABLE
BOOST_SOURCE_PATH)
exec_program(ls ARGS -d ${BOOST_SOURCE_PATH}/boost* OUTPUT_VARIABLE
BOOST_INCLUDE_DIR)
include_directories(${BOOST_INCLUDE_DIR})
add_definitions(-DUSE_FOLLY -DFOLLY_NO_CONFIG)
list(APPEND THIRDPARTY_LIBS glog)
endif()
Expand Down Expand Up @@ -1108,11 +1122,15 @@ set(BUILD_VERSION_CC ${CMAKE_BINARY_DIR}/build_version.cc)
configure_file(util/build_version.cc.in ${BUILD_VERSION_CC} @ONLY)

add_library(${ROCKSDB_STATIC_LIB} STATIC ${SOURCES} ${BUILD_VERSION_CC})
target_include_directories(${ROCKSDB_STATIC_LIB} PUBLIC
$<BUILD_INTERFACE:${PROJECT_SOURCE_DIR}/include>)
target_link_libraries(${ROCKSDB_STATIC_LIB} PRIVATE
${THIRDPARTY_LIBS} ${SYSTEM_LIBS})

if(ROCKSDB_BUILD_SHARED)
add_library(${ROCKSDB_SHARED_LIB} SHARED ${SOURCES} ${BUILD_VERSION_CC})
target_include_directories(${ROCKSDB_SHARED_LIB} PUBLIC
$<BUILD_INTERFACE:${PROJECT_SOURCE_DIR}/include>)
target_link_libraries(${ROCKSDB_SHARED_LIB} PRIVATE
${THIRDPARTY_LIBS} ${SYSTEM_LIBS})

Expand Down Expand Up @@ -1272,6 +1290,7 @@ if(WITH_TESTS)
cache/cache_test.cc
cache/compressed_secondary_cache_test.cc
cache/lru_cache_test.cc
cache/tiered_secondary_cache_test.cc
db/blob/blob_counting_iterator_test.cc
db/blob/blob_file_addition_test.cc
db/blob/blob_file_builder_test.cc
Expand Down Expand Up @@ -1367,6 +1386,7 @@ if(WITH_TESTS)
db/wal_edit_test.cc
db/wide/db_wide_basic_test.cc
db/wide/wide_column_serialization_test.cc
db/wide/wide_columns_helper_test.cc
db/write_batch_test.cc
db/write_callback_test.cc
db/write_controller_test.cc
Expand Down Expand Up @@ -1442,6 +1462,7 @@ if(WITH_TESTS)
utilities/cassandra/cassandra_format_test.cc
utilities/cassandra/cassandra_row_merge_test.cc
utilities/cassandra/cassandra_serialize_test.cc
utilities/flink/flink_compaction_filter_test.cc
utilities/checkpoint/checkpoint_test.cc
utilities/env_timed_test.cc
utilities/flink/flink_compaction_filter_test.cc
Expand Down Expand Up @@ -1603,6 +1624,3 @@ option(WITH_BENCHMARK "build benchmark tests" OFF)
if(WITH_BENCHMARK)
add_subdirectory(${PROJECT_SOURCE_DIR}/microbench/)
endif()

target_include_directories(${PROJECT_NAME} PUBLIC
$<BUILD_INTERFACE:${PROJECT_SOURCE_DIR}/include>)
Empty file added HISTORY.md
Empty file.
4 changes: 2 additions & 2 deletions INSTALL.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ There are few options when compiling RocksDB:
* `make check` will compile and run all the unit tests. `make check` will compile RocksDB in debug mode.

* `make all` will compile our static library, and all our tools and unit tests. Our tools
depend on gflags. You will need to have gflags installed to run `make all`. This will compile RocksDB in debug mode. Don't
depend on gflags 2.2.0 or newer. You will need to have gflags installed to run `make all`. This will compile RocksDB in debug mode. Don't
use binaries compiled by `make all` in production.

* By default the binary we produce is optimized for the CPU you're compiling on
Expand Down Expand Up @@ -77,7 +77,7 @@ most processors made since roughly 2013.

git clone https://github.com/gflags/gflags.git
cd gflags
git checkout v2.0
git checkout v2.2.0
./configure && make && sudo make install

**Notice**: Once installed, please add the include path for gflags to your `CPATH` environment variable and the
Expand Down
Loading
Loading