Code

WIP herbie#1860

Code

Draft

wsmoses wants to merge 223 commits intomainEnzymeAD/Enzyme:mainfrom herbieEnzymeAD/Enzyme:herbieCopy head branch name to clipboard

+6,240-290

Commits

Commits on May 6, 2024

• WIP herbie

  wsmoses

  committed
  f2400db

Commits on May 10, 2024

• build commands

  sbrantq

  committed
  e2fd7b2

• add stuff

  sbrantq

  committed
  4dc7fdb

• append newline

  sbrantq

  committed
  cfcdfe4

• fix include

  sbrantq

  committed
  5cb6b65

• improve

  sbrantq

  committed
  0b6bb14

• get standalone binary

  sbrantq

  committed
  36c8a7e

• fix arg

  sbrantq

  committed
  b0cc1f3

Commits on May 15, 2024

• fix macro

  sbrantq

  committed
  8acb959

• cleanup

  sbrantq

  committed
  b5e3c9f

Commits on May 16, 2024

• complete boilerplate

  sbrantq

  committed
  2ff561c

• use herbie improve instead

  sbrantq

  committed
  13060e5

• saving progress

  sbrantq

  committed
  3326cf3

Commits on May 28, 2024

• saving progress

  sbrantq

  committed
  b8a8201

• fix regex

  sbrantq

  committed
  becf55e

Commits on May 30, 2024

• saving progress

  sbrantq

  committed
  b74c899

• improve

  sbrantq

  committed
  15528af

• disable lit parallelism

  sbrantq

  committed
  20c5464

• add tests

  sbrantq

  committed
  4b800fc

Commits on May 31, 2024

• handle constants

  sbrantq

  committed
  17de042

• more test & fast math flags

  sbrantq

  committed
  8e98bb3

• cleanup

  sbrantq

  committed
  4f4106e

Commits on Jun 6, 2024

• add working generalized code

  sbrantq

  committed
  c7ad4b3

• cleanup

  sbrantq

  committed
  6c25238

• improve

  sbrantq

  committed
  16df413

• improve type casting

  sbrantq

  committed
  5de75d8

Commits on Jun 8, 2024

• add call instruction support

  sbrantq

  committed
  0b431e4

• version check for tan

  sbrantq

  committed
  c4a3b53

• fix herbie seed

  sbrantq

  committed
  add02ff

Commits on Jun 9, 2024

• memory management

  sbrantq

  committed
  beef25a

• std::vector --> SmallVector

  sbrantq

  committed
  6d8e9c1

Commits on Jun 12, 2024

• cleanup with O3 pass?

  sbrantq

  committed
  215c766

• sign

  sbrantq

  committed
  48e0dcf

• add simple phi node test

  sbrantq

  committed
  c072ac5

• unique file names for parallel tests

  sbrantq

  committed
  3763219

Commits on Jun 13, 2024

• adjust O3 flag

  sbrantq

  committed
  7efa80d

Commits on Jun 14, 2024

• saving progress

  sbrantq

  committed
  69eb6d3

Commits on Jun 17, 2024

• better cleanup

  sbrantq

  committed
  da12b38

Commits on Jun 18, 2024

• merge stuff from main

  sbrantq

  committed
  f6dfe4f

• demangle log func

  sbrantq

  committed
  3272642

Commits on Jun 19, 2024

• pass operands to the logger

  sbrantq

  committed
  dce1297

Commits on Jun 20, 2024

• improve logging

  sbrantq

  committed
  9f5ed15

• add more complex logger

  sbrantq

  committed
  3aac534

• improve

  sbrantq

  committed
  0fa0343

• set debug loc for logger call

  sbrantq

  committed
  f3f966d

Commits on Jun 23, 2024

• move logger to separate file

  sbrantq

  committed
  5bced48

• improve

  sbrantq

  committed
  848fd56

Commits on Jun 24, 2024

• fix constants

  sbrantq

  committed
  d39c34c

• if expr from Herbie

  sbrantq

  committed
  421c6e4

• herbie properties

  sbrantq

  committed
  254175b

• improve

  sbrantq

  committed
  f2b156e

• macro

  sbrantq

  committed
  dc65ec7

Commits on Jun 25, 2024

• bool flag for err msg

  sbrantq

  committed
  03dc9b8

• improve

  sbrantq

  committed
  6bc269a

• manual arg eval & inf handling

  sbrantq

  committed
  a21348b

Commits on Jun 26, 2024

• cbrt

  sbrantq

  committed
  0a2ccbc

• large Herbie constant handling

  sbrantq

  committed
  60d946d

• simplify

  sbrantq

  committed
  ca87346

• WIP preconditions

  sbrantq

  committed
  4259b00

Commits on Jun 27, 2024

• fwddiffe -> fwderr

  sbrantq

  committed
  cd27b90

Commits on Jul 1, 2024

• add mode selection

  sbrantq

  committed
  7ec2346

• preprocess orig metadata

  sbrantq

  committed
  ea59ad1

• neg

  sbrantq

  committed
  8c520e7

Commits on Jul 2, 2024

• register fpopt

  sbrantq

  committed
  11bac95

• only preprocess origin metadata to fp inst

  sbrantq

  committed
  2af3c11

• ifdef ENZYME_ENABLE_HERBIE

  sbrantq

  committed
  6f457fd

Commits on Jul 3, 2024

• denormals

  sbrantq

  committed
  4336ed0

• logged bounds for fpconst

  sbrantq

  committed
  ecf1aa1

Commits on Jul 4, 2024

• fix bounds parsing

  sbrantq

  committed
  32dbbd5

• preconditions

  sbrantq

  committed
  0d005db

• skip declarations

  sbrantq

  committed
  77f8887

• simplify printed info

  sbrantq

  committed
  66a7ae3

• post opt erasure check

  sbrantq

  committed
  7156848

• update fpopt tests to include debug flags

  sbrantq

  committed
  1c29d2c

Commits on Jul 5, 2024

• print

  sbrantq

  committed
  294c2a2

• add labels to herbie-generated stuff

  sbrantq

  committed
  4b8e17a

Commits on Jul 6, 2024

• more tests

  sbrantq

  committed
  a7e134c

• fmuladd

  sbrantq

  committed
  9802904

• fix test

  sbrantq

  committed
  cc53c46

• hypot

  sbrantq

  committed
  a5a450c

• fix bounds parsing

  sbrantq

  committed
  0aab938

• more tests

  sbrantq

  committed
  19443d8

• expm1 + log1p + precond fix

  sbrantq

  committed
  0cb80da

Commits on Jul 7, 2024

• fix test

  sbrantq

  committed
  3c16766

• make cbrt herbiable

  sbrantq

  committed
  f507934

• WIP llvm instruction cost model

  sbrantq

  committed
  1c7cf06

Commits on Jul 8, 2024

• subexpr cost estimate

  sbrantq

  committed
  01d4f8d

• improve

  sbrantq

  committed
  2b14f05

• WIP solver

  sbrantq

  committed
  7a4be5e

• fix

  sbrantq

  committed
  39973f0

Commits on Jul 11, 2024

• saving progress

  sbrantq

  committed
  d272fd0

Commits on Jul 12, 2024

• more herbie knobs

  sbrantq

  committed
  1e06089

Commits on Jul 15, 2024

• reverse mode logging

  sbrantq

  committed
  29438c3

Commits on Jul 16, 2024

• cleanup

  sbrantq

  committed
  8e0a0bb

• only log grad

  sbrantq

  committed
  23f2a7c

• fix test

  sbrantq

  committed
  0b51aa0

Commits on Jul 18, 2024

• multiple expr handling

  sbrantq

  committed
  7544cb2

Commits on Jul 19, 2024

• grad log parsing + improvements

  sbrantq

  committed
  3d015f1

• improve

  sbrantq

  committed
  69e7bbf

Commits on Jul 21, 2024

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  cf89257

• improve herbie's build cmd

  sbrantq

  committed
  b54886f

Commits on Jul 23, 2024

• TTI costs

  sbrantq

  committed
  e9bdadf

• saving solvers

  sbrantq

  committed
  9df9349

• fix alternatives

  sbrantq

  committed
  a2afd2d

Commits on Jul 25, 2024

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  138d8fa

Commits on Jul 28, 2024

• fix dp solver

  sbrantq

  committed
  42ed544

• update herbie hash

  sbrantq

  committed
  b16bbcf

• update tests

  sbrantq

  committed
  32949f0

• constantexpr

  sbrantq

  committed
  7fc69b9

Commits on Jul 29, 2024

• get log func

  sbrantq

  committed
  00259d4

• improve

  sbrantq

  committed
  7fe0519

Commits on Jul 30, 2024

• separating out value logging

  sbrantq

  committed
  304a162

• add unified logger

  sbrantq

  committed
  bfa4c61

• differential usage for reverse mode value logging

  sbrantq

  committed
  09bd80f

• log value before constant inst check

  sbrantq

  committed
  ee85f63

Commits on Jul 31, 2024

• unified logger

  sbrantq

  committed
  4c1cf63

Commits on Aug 1, 2024

• solver selection

  sbrantq

  committed
  ae4ef9a

• log parsing bug fix

  sbrantq

  committed
  a18b006

• log parsing bug fix

  sbrantq

  committed
  ba4bf0a

Commits on Aug 2, 2024

• WIP typing

  sbrantq

  committed
  9056ed1

Commits on Aug 3, 2024

• fix f32

  sbrantq

  committed
  9b3a08d

• minor fixes

  sbrantq

  committed
  afff45f

Commits on Aug 4, 2024

• use libm func instead

  sbrantq

  committed
  5e6cff4

Commits on Aug 6, 2024

• minor improvements and make fabs non-herbiable

  sbrantq

  committed
  3592826

• fpcc splitting algorithm

  sbrantq

  committed
  0e7bd4f

• saving

  sbrantq

  committed
  748d08a

Commits on Aug 16, 2024

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  a577bcb

Commits on Aug 25, 2024

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  9f81169

• fix include

  sbrantq

  committed
  cd79402

Commits on Aug 28, 2024

• fix

  sbrantq

  committed
  7006efb

Commits on Aug 30, 2024

• regex target func spec

  sbrantq

  committed
  ddb9307

Commits on Aug 31, 2024

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  3413835

• fix

  sbrantq

  committed
  ffb255d

• improve

  sbrantq

  committed
  5c123ed

Commits on Sep 3, 2024

• cleanup

  sbrantq

  committed
  1d0c686

• fix tests

  sbrantq

  committed
  2f876a4

• improve

  sbrantq

  committed
  8ebd39e

Commits on Sep 7, 2024

• FP subgraph precision changing

  sbrantq

  committed
  f42e7e8

• comments

  sbrantq

  committed
  0213868

Commits on Sep 8, 2024

• improve

  sbrantq

  committed
  7dc2be9

• rename FPNode::getValue & WIP unified accuracy

  sbrantq

  committed
  1b0a985

Commits on Sep 9, 2024

• RTTI

  sbrantq

  committed
  64afdbb

Commits on Sep 15, 2024

• improve

  sbrantq

  committed
  931f723

Commits on Sep 16, 2024

• shared ptr & WIP golden values

  sbrantq

  committed
  0e51d51

• improve

  sbrantq

  committed
  8fe7098

Commits on Sep 17, 2024

• accuracy cost estimator for herbie rewrites

  sbrantq

  committed
  9480b7c

Commits on Sep 20, 2024

• random engine

  sbrantq

  committed
  4a80236

• fix dp solver

  sbrantq

  committed
  4fa39d1

• guaranteed erasable cost in expressions

  sbrantq

  committed
  bb5b917

• fix

  sbrantq

  committed
  4a2f996

Commits on Sep 21, 2024

• WIP PT candidate generation

  sbrantq

  committed
  59da2ab

Commits on Sep 22, 2024

• generalize

  sbrantq

  committed
  845f74a

• use AST nodes in precision tuning

  sbrantq

  committed
  026e334

Commits on Sep 23, 2024

• generalized mpfr evaluator

  sbrantq

  committed
  b9b3194

• unified accuracy cost done

  sbrantq

  committed
  bacca3b

• improve

  sbrantq

  committed
  4a5a621

• fixed accuracy cost for fpcc

  sbrantq

  committed
  e7a65fe

Commits on Sep 29, 2024

• save

  sbrantq

  committed
  ef23ce8

• fix up

  sbrantq

  committed
  df3087a

• renaming

  sbrantq

  committed
  498ce49

• custom cost model parsing & disable FP16 for now

  sbrantq

  committed
  d97de6c

Commits on Sep 30, 2024

• save

  sbrantq

  committed
  0621807

• generalized dp solver

  sbrantq

  committed
  834d7c3

• fix up

  sbrantq

  committed
  066ec46

Commits on Oct 1, 2024

• bug fix & ruling out NaNs in acc cost estimation

  sbrantq

  committed
  98d425a

Commits on Oct 3, 2024

• more precisions & fmuladd --> fma

  sbrantq

  committed
  5371a97

• cleanup after PT

  sbrantq

  committed
  f7ef6d2

• costom cost model opcode suffix for fpcasts

  sbrantq

  committed
  ec7a55b

• fix erasable inst check

  sbrantq

  committed
  4e2fbb4

Commits on Oct 4, 2024

• save

  sbrantq

  committed
  6953b7a

• Explicit topo sort

  sbrantq

  committed
  84ab293

Commits on Oct 5, 2024

• adjusted cost estimation & accuracy estimation bug fix

  sbrantq

  committed
  829185a

• Only enable float double conversions

  sbrantq

  committed
  33cd1b0

Commits on Oct 6, 2024

• early pruning flag

  sbrantq

  committed
  d6dd10d

Commits on Oct 7, 2024

• ADAPT-style sensitivity estimation

  sbrantq

  committed
  aa52ecd

Commits on Oct 9, 2024

• always fpcast operands first in MPFR evaluator

  sbrantq

  committed
  74dbaff

• AO/ACC sampled points consistency fix

  sbrantq

  committed
  0ebc1d8

Commits on Oct 10, 2024

• ponder fast math flags

  sbrantq

  committed
  2c859a4

Commits on Oct 15, 2024

• bug fix

  sbrantq

  committed
  8309529

Commits on Oct 16, 2024

• complete PT & improve

  sbrantq

  committed
  af67a08

• caching for adjusted ACC costs

  sbrantq

  committed
  7488586

Commits on Oct 17, 2024

• improve

  sbrantq

  committed
  77992eb

• fix

  sbrantq

  committed
  859a954

Commits on Oct 29, 2024

• more PT candidates

  sbrantq

  committed
  a9b615e

• better temp expr materialization & cost estimation

  sbrantq

  committed
  653cf32

Commits on Oct 30, 2024

• solution dominance thresholds

  sbrantq

  committed
  a558385

Commits on Oct 31, 2024

• save

  sbrantq

  committed
  274366c

• native fp emulator

  sbrantq

  committed
  f4965a4

• more options

  sbrantq

  committed
  e381dd2

Commits on Nov 2, 2024

• save

  sbrantq

  committed
  90cb151

Commits on Nov 3, 2024

• save

  sbrantq

  committed
  f38c611

• print ranges only

  sbrantq

  committed
  27ed106

Commits on Nov 4, 2024

• fix up

  sbrantq

  committed
  e433e5d

• bug fix

  sbrantq

  committed
  08c4db8

• improve

  sbrantq

  committed
  46f7d11

Commits on Nov 5, 2024

• bug fix

  sbrantq

  committed
  67b5944

Commits on Nov 7, 2024

• fix

  sbrantq

  committed
  033bbcf

• bug fix

  sbrantq

  committed
  845cbf5

Commits on Nov 8, 2024

• remove duplicated expr

  sbrantq

  committed
  60a6ddd

• accuracy cost evaluation: arithmetic avg --> geometric avg

  sbrantq

  committed
  fe0b354

• add some progress indication

  sbrantq

  committed
  da75044

• fix up

  sbrantq

  committed
  bb020b4

• fix up

  sbrantq

  committed
  6631026

• parallel herbie

  sbrantq

  committed
  c67f13d

• disable herbie parallelism by default

  sbrantq

  committed
  91456e2

• fix up

  sbrantq

  committed
  bd013be

• fix up

  sbrantq

  committed
  f4f7335

• fix up

  sbrantq

  committed
  50abba3

• dp solver fix up

  sbrantq

  committed
  003de29

Commits on Nov 9, 2024

• improve

  sbrantq

  committed
  1b65a8c

• save

  sbrantq

  committed
  b49de51

Commits on Nov 10, 2024

• experimental herbie output caching

  sbrantq

  committed
  0e7a6d7

• bug fix

  sbrantq

  committed
  52950d5

Commits on Nov 11, 2024

• FPEvaluator: add hypot

  sbrantq

  committed
  5f39b98

• Merge branch 'main' of https://github.com/EnzymeAD/Enzyme into herbie

  sbrantq

  committed
  53a57a7

• just skip unexecuted code

  sbrantq

  committed
  7eb617e

Commits on Nov 12, 2024

• adapted to poseidon

  sbrantq

  committed
  7145c49

• enzyme_active

  sbrantq

  committed
  e39bee8

• bug fix

  sbrantq

  committed
  5b94be0

Commits on Nov 13, 2024

• prune on boundaries

  sbrantq

  committed
  a8dede8

Commits on Nov 26, 2024

• dp table caching

  sbrantq

  committed
  dffbd51

• range widening

  sbrantq

  committed
  1d88952

Commits on Dec 2, 2024

• fix up

  sbrantq

  committed
  882cd35