Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 25, 2025

• [BFCL] Remove latency data for open source models (#1033)

  Show description for 58f9634
  errorfourten

  authored
  58f9634

  Copy full SHA for 58f9634

Commits on May 24, 2025

• [BFCL] Add Qwen 3 Series Models to the Leaderboard (#1015)

  Show description for d04871e
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  d04871e

  Copy full SHA for d04871e

• Add gemini-2.5-pro-preview-05-06 Models (#1031)

  Show description for 63ea3ac
  

  Guangyu-Joshua-Feng

  and

  HuanzhiMao

  authored
  63ea3ac

  Copy full SHA for 63ea3ac

Commits on May 21, 2025

• Migrate to correct testing API (#1029)

  Show description for 6e702ba
  emmanuel-ferdman

  authored
  6e702ba

  Copy full SHA for 6e702ba

Commits on May 20, 2025

• Support API inference for `QwQ-32B` (#1014)

  Show description for e004dc3
  

  CostaliyA

  and

  HuanzhiMao

  authored
  e004dc3

  Copy full SHA for e004dc3

• [BFCL] fix entry id typo in `live_multiple_1052-279-0` (#1022)

  Show description for 406c78a
  itea1001

  authored
  406c78a

  Copy full SHA for 406c78a

Commits on May 2, 2025

• [BFCL] Update Error Message for New Handler Mappings (#1013)

  Show description for 56d7a7c
  catherineruoxiwu

  authored
  56d7a7c

  Copy full SHA for 56d7a7c

Commits on May 1, 2025

• [BFCL] Add Validation for Model Names (#1008)

  Show description for 63442e1
  catherineruoxiwu

  authored
  63442e1

  Copy full SHA for 63442e1

Commits on Apr 26, 2025

• [BFCL] add model config (#999)

  Show description for 61f8a4f
  

  itea1001

  and

  HuanzhiMao

  authored
  61f8a4f

  Copy full SHA for 61f8a4f

• Bump `writer-sdk` Dependency Version (#1006)

  Show description for e7f7365
  HuanzhiMao

  authored
  e7f7365

  Copy full SHA for e7f7365

Commits on Apr 25, 2025

• [BFCL] Add GPT 4.1 Series Models to the Leaderboard. (#1002)

  Show description for 1dedb82
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  1dedb82

  Copy full SHA for 1dedb82

Commits on Apr 24, 2025

• [BFCL] Add `microsoft/phi-4` to the Leaderboard (#1000)

  Show description for c6e1af3
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  c6e1af3

  Copy full SHA for c6e1af3

• [BFCL] add support for microsoft/Phi-4-mini-instruct (#967)

  Show description for a84eb80
  

  RobotSail

  and

  HuanzhiMao

  authored
  a84eb80

  Copy full SHA for a84eb80

Commits on Apr 23, 2025

• [BFCL] Retire Outdated Models from the Leaderboard (#997)

  Show description for 2559c6a
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  2559c6a

  Copy full SHA for 2559c6a

• Add xiaoming-14B (#977)

  Show description for 39b7224
  

  3 peopleauthored
  39b7224

  Copy full SHA for 39b7224

• [BFCL] Add mistral-large-2411 and mistral-small-2503 (#988)

  Show description for 9d6abd5
  

  pracheeti12

  and

  HuanzhiMao

  authored
  9d6abd5

  Copy full SHA for 9d6abd5

Commits on Apr 22, 2025

• [BFCL] Add Grok 3 Models to the Leaderboard (#987)

  Show description for 3529321
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  3529321

  Copy full SHA for 3529321

Commits on Apr 18, 2025

• Add ThinkAgents/ThinkAgent-1B (#928)

  Show description for 4156220
  

  0xayman

  and

  HuanzhiMao

  authored
  4156220

  Copy full SHA for 4156220

• Fix Typo in Model Name for `xLAM-2-8b-fc-r` (#992)

  Show description for 1a24d57
  HuanzhiMao

  authored
  1a24d57

  Copy full SHA for 1a24d57

Commits on Apr 17, 2025

• [BFCL] Add Support for Fully Offline Model Inference via `--local-model-path` (#985)

  Show description for a4dcd65
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  a4dcd65

  Copy full SHA for a4dcd65

Commits on Apr 13, 2025

• [BFCL] Add New Models `Llama-4-Scout`, `Llama-4-Maverick` (#981)

  Show description for 9108a65
  HuanzhiMao

  authored
  9108a65

  Copy full SHA for 9108a65

• feat. Add Novita LLM Models API (#980)

  Show description for c6808d2
  

  novita-viktor

  and

  HuanzhiMao

  authored
  c6808d2

  Copy full SHA for c6808d2

Commits on Apr 10, 2025

• [BFCL] Retire Executable Categories from Leaderboard (#943)

  Show description for 4ed459c
  HuanzhiMao

  authored
  4ed459c

  Copy full SHA for 4ed459c

Commits on Apr 9, 2025

• Add Salesforce xLAM-2 series of model handlers and update vLLM version from 0.6.3 to 0.6.5 (#972)

  Show description for 4d05b53
  

  zuxin666

  and

  HuanzhiMao

  authored
  4d05b53

  Copy full SHA for 4d05b53

• [BFCL] Fix Typo in `multi_turn_base_166` Ground Truth. (#979)

  Show description for 11cb4fe
  HuanzhiMao

  authored
  11cb4fe

  Copy full SHA for 11cb4fe

Commits on Apr 8, 2025

• [BFCL] Update Retry Logic for Gemini Models (#976)

  Show description for afcff48
  HuanzhiMao

  authored
  afcff48

  Copy full SHA for afcff48

• [BFCL] Add `gemini-2.5-pro` to the Leaderboard (#974)

  Show description for b6d3eef
  

  3 peopleauthored
  b6d3eef

  Copy full SHA for b6d3eef

Commits on Apr 3, 2025

• [BFCL] Reorganizing Codes in `./bfcl/eval_checker/executable_eval/data/` (#954)

  Show description for d6b5fb8
  catherineruoxiwu

  authored
  d6b5fb8

  Copy full SHA for d6b5fb8

Commits on Mar 27, 2025

• [BFCL] Moved Ground Truths for Executable Tests to `./data/possible_answer` Folder (#953)

  Show description for d0299e6
  

  catherineruoxiwu

  and

  HuanzhiMao

  authored
  d0299e6

  Copy full SHA for d0299e6

Commits on Mar 26, 2025

• [BFCL] Fix wrong date in live_simple_205-116-13 (#963)

  Show description for 375b772
  

  amitojsingh2022

  and

  HuanzhiMao

  authored
  375b772

  Copy full SHA for 375b772

• [BFCL] Fix API Keys Handling (#959)

  Show description for a48d2bb
  catherineruoxiwu

  authored
  a48d2bb

  Copy full SHA for a48d2bb

• [BFCL] Fix ambiguity in exec_parallel_10 question (#962)

  Show description for 7f35860
  

  amitojsingh2022

  and

  HuanzhiMao

  authored
  7f35860

  Copy full SHA for 7f35860

• [BFCL] Use HTTPS instead of HTTP for OMDB (#960)

  Show description for d852a7e
  

  hrshtv

  and

  HuanzhiMao

  authored
  d852a7e

  Copy full SHA for d852a7e

• Reformatted Supported Model Table (#961)

  Show description for 1854548
  

  JasonHuang1103

  and

  HuanzhiMao

  authored
  1854548

  Copy full SHA for 1854548

Commits on Mar 20, 2025

• Add Cohere Command A (#951)

  Show description for 96b1f18
  

  3 peopleauthored
  96b1f18

  Copy full SHA for 96b1f18

Pagination

Previous

Next