Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: FasterDecoding/REST
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: FasterDecoding/REST
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: llama3
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 3 commits
  • 4 files changed
  • 2 contributors

Commits on Nov 22, 2024

  1. Support DraftRetriever datastore read/write for large vocab sizes (i.… 

    …e. llama3+) and REST inference for llama3 (#24)

* support large vocab sizes (i.e. llama3) for DraftRetriever datastore

* updates comments to explain implementation changes

* modify modeling_llama_kv for llama3 compatibility
    @scandukuri
    scandukuri authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    ff9d5e4 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2024

  1. fix bug for vocab size

    @zhenyuhe00
    zhenyuhe00 authored Dec 2, 2024
    Configuration menu
    Copy the full SHA
    f9a6e7b View commit details
    Browse the repository at this point in the history

  2. fix bug for vocab size

    @zhenyuhe00
    zhenyuhe00 authored Dec 2, 2024
    Configuration menu
    Copy the full SHA
    fc9ba2d View commit details
    Browse the repository at this point in the history
Loading