Skip to content

[Autoloop: perf-comparison] - #435

Draft
github-actions[bot] wants to merge 107 commits into
mainfrom
autoloop/perf-comparison
Draft

[Autoloop: perf-comparison]#435
github-actions[bot] wants to merge 107 commits into
mainfrom
autoloop/perf-comparison

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.

Autoloop: perf-comparison

Goal: Benchmark every tsb function vs pandas equivalent.

Current Best Metric: 756 benchmarked function pairs

Program Issue: #221


Latest Iteration (418)

Added firstValidIndex / lastValidIndex benchmarks:

  • TypeScript: benchmarks/tsb/bench_first_last_valid_index.ts — 100k-row Series with NaN at start, end, and scattered; 500 measured iterations
  • Python: benchmarks/pandas/bench_first_last_valid_index.py — matching dataset and loop structure using Series.first_valid_index() / Series.last_valid_index()

Metric: 755 → 756 (+1)

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • releaseassets.githubusercontent.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "releaseassets.githubusercontent.com"

See Network Configuration for more information.

Generated by Autoloop · 1.4K AIC · ⌖ 12.1 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

…ndex benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30010910150

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
github-actions Bot and others added 2 commits July 23, 2026 13:33
Benchmark BooleanArray extension array (100k elements, ~10% nulls, 50 iters):
from/any/all/sum/and/or/not/fillna. TS: arrays.BooleanArray from tsb;
Python: pd.array(dtype='boolean').

Run: https://github.com/githubnext/tsb/actions/runs/30058807058

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 402ebd6

Generated by Autoloop · 983.4 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 8d70dac

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

🤖 Iteration 420✅ Accepted

  • Change: Added StringArray extension array benchmarks (bench_string_array.ts / bench_string_array.py)
  • Metric: 758 (best: 758, delta: +1)
  • Commit: 8d70dac
  • Result: Benchmarks cover from/upper/lower/strip/contains/len/fillna on 100k-element arrays with ~10% nulls (50 measured iterations). Python uses pd.array(dtype="string") with equivalent .str accessor methods.

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

Add bench_datetime_array.ts and bench_datetime_array.py benchmarking
nullable datetime extension array: from/year/month/day/isna/notna/fillna.
100k elements with ~10% nulls, 50 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30138360760

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 7500ea9

Generated by Autoloop · 669.6 AIC · ⌖ 11.8 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 01:30
Add bench_timedelta_array.ts and bench_timedelta_array.py benchmarks for
TimedeltaArray (100k elements, ~10% nulls, 50 iters): from/days/hours/
totalSeconds/isna/notna/sum/min/max/fillna.

Run: https://github.com/githubnext/tsb/actions/runs/30159549081

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 744e7b2

Generated by Autoloop · 845.1 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 13:32
Add matched TypeScript + Python benchmarks for Gaussian KDE (evaluate + integrate)
on a bimodal 10k-point dataset with 200 evaluation points, 20 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30182788398

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: dfda6b1

Generated by Autoloop · 1.8K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 66c5b82

Generated by Autoloop · 678.6 AIC · ⌖ 11.6 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 26, 2026 13:29
…tropy/jsDivergence/jsDistance/crossEntropy benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30248425219

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6fdb111

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 27, 2026 08:17
…alEntropy/variationOfInformation benchmark

1000-element paired observations, 10 categories, 50 iters each.
Python: pure-numpy implementations matching tsb semantics.

Run: https://github.com/githubnext/tsb/actions/runs/30297867311

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 320e47d

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

…ction benchmark

Benchmark mergeAsof with direction="forward" (smallest right key >= left key).
Only the default backward direction was previously covered.

Run: https://github.com/githubnext/tsb/actions/runs/31856202878

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: d19f908

Generated by Autoloop · 7.3K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 80d2324

Generated by Autoloop · 1.7K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 15, 2026 13:26
…arterEnd/Begin, BMonthEnd/Begin, BYearEnd/Begin apply/rollforward/rollback on 5k dates

Run: https://github.com/githubnext/tsb/actions/runs/31919325615

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6b5ab0b

Generated by Autoloop · 2.1K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 16, 2026 01:36
…/dataFrameAbs/seriesRound/dataFrameRound on 100k-row dataset

Run: https://github.com/githubnext/tsb/actions/runs/31948913632

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: ed7dc53

Generated by Autoloop · 1.2K AIC · ⌖ 12.2 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 16, 2026 13:21
…rgence functions

Add bench_information_divergence for jsDivergence, jsDistance, crossEntropy,
renyiEntropy, tsallisEntropy, jointEntropy, conditionalEntropy, and
variationOfInformation from src/stats/information.ts — the last unbenchmarked
information-theory functions.

Run: https://github.com/githubnext/tsb/actions/runs/31984632889

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 5990466

Generated by Autoloop · 969.2 AIC · ⌖ 12.2 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 935afb3

Generated by Autoloop · 1.5K AIC · ⌖ 12.5 AIC · ⊞ 51.8K

…marks

Benchmarks pandas.api.types value-level predicates (isScalar, isListLike,
isArrayLike, isDictLike, isIterator, isNumber, isBool, isFloat, isInteger,
isMissing, isHashable, isDate) against their tsb equivalents.

Run: https://github.com/githubnext/tsb/actions/runs/32087829947

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: ba8f1ae

Generated by Autoloop · 936 AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 18, 2026 01:28
…earchsortedAccelerated / searchsortedManyAccelerated / argsortScalarsAccelerated vs numpy

Run: https://github.com/githubnext/tsb/actions/runs/32140867086

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: d543b0c

Generated by Autoloop · 3.6K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 18, 2026 13:33
…DataFrame eq/ne/lt/gt/le/ge vs scalar and DataFrame

Run: https://github.com/githubnext/tsb/actions/runs/32204535885

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: d81c690

Generated by Autoloop · 1.2K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 19, 2026 01:31
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: aa5bd50

Generated by Autoloop · 933.5 AIC · ⌖ 12 AIC · ⊞ 51.8K

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants