Skip to content

Incorrect list of supported batch AI models #21718

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
mgoodge opened this issue Apr 15, 2025 · 1 comment
Closed

Incorrect list of supported batch AI models #21718

mgoodge opened this issue Apr 15, 2025 · 1 comment
Assignees
Labels
product:workers-ai Workers AI: https://developers.cloudflare.com/workers-ai/

Comments

@mgoodge
Copy link

mgoodge commented Apr 15, 2025

Example URL(s)

https://developers.cloudflare.com/workers-ai/features/batch-api/

Actual Behavior

The list of supported models for AI batch processing includes @cf/meta/llama-3.3-70b-instruct-fp8-fast.

However, when run against the REST API, trying to use this model returns an error:

[errors] => Array
(
[0] => Array
(
[message] => AiError: Ai: This model does not support request queuing (f76e541f-d076-4869-9130-ee14913a9159)
[code] => 8007
)
)

Expected Behavior

Models listed on this page should support batch processing.

Additional information

No response

@mgoodge mgoodge added the engineering Problems or updates to developers.cloudflare.com website label Apr 15, 2025
@kodster28 kodster28 assigned thatsKevinJain and unassigned KianNH Apr 15, 2025
@kodster28 kodster28 added product:workers-ai Workers AI: https://developers.cloudflare.com/workers-ai/ and removed engineering Problems or updates to developers.cloudflare.com website labels Apr 15, 2025
@kodster28
Copy link
Contributor

Howdy @mgoodge, chatted with ENG and this should be fixed!

Closing out this issue as completed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
product:workers-ai Workers AI: https://developers.cloudflare.com/workers-ai/
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants
@mgoodge @thatsKevinJain @kodster28 @KianNH and others