Skip to content

feat: openai wandb sync #64

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 28 commits into from
Feb 1, 2022
Merged
Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
9a6d168
feat: log fine_tune with wandb
borisdayma Nov 3, 2021
a246785
feat: ensure we are logged in
borisdayma Nov 4, 2021
b24d1b6
feat: cli wandb namespace
borisdayma Nov 4, 2021
dfb67fa
feat: add fine_tuned_model to summary
borisdayma Nov 4, 2021
1036d6d
feat: log training & validation files
borisdayma Nov 4, 2021
bb3def6
feat: re-log if was not successful or force
borisdayma Nov 4, 2021
2d34eb2
doc: add docstring
borisdayma Nov 4, 2021
0b0f456
feat: set wandb api only when needed
borisdayma Nov 4, 2021
c948a2e
fix: train/validation files are inputs
borisdayma Nov 4, 2021
1d10235
feat: rename artifact type
borisdayma Nov 4, 2021
146cdaa
feat: improve config logging
borisdayma Nov 4, 2021
ce7352e
feat: log all jobs by default
borisdayma Nov 5, 2021
5e6dbe9
feat: log job details
borisdayma Nov 5, 2021
00111ba
feat: log -> sync
borisdayma Nov 6, 2021
9a3edcb
feat: cli wandb log -> sync
borisdayma Nov 9, 2021
2c151f3
fix: validation_files not always present
borisdayma Dec 2, 2021
9eccf84
feat: format created_at + style
borisdayma Dec 3, 2021
84c2cbd
feat: log number of training/validation samples
borisdayma Dec 3, 2021
6650b39
Merge branch 'main' of https://github.com/openai/openai-python
borisdayma Jan 13, 2022
8ac09d3
feat(wandb): avoid download if file already synced
borisdayma Jan 18, 2022
08ef4de
feat(wandb): add number of items to metadata
borisdayma Jan 18, 2022
9c3738c
fix(wandb): allow force sync
borisdayma Jan 18, 2022
39e747c
feat(wandb): job -> fine-tune
borisdayma Jan 19, 2022
0b1751d
refactor(wandb): use show_individual_warnings
borisdayma Jan 19, 2022
81db437
feat(wandb): Logger -> WandbLogger
borisdayma Jan 19, 2022
e6f154f
feat(wandb): retrive number of items from artifact
borisdayma Jan 19, 2022
6c57ef5
Merge branch 'main' of https://github.com/openai/openai-python
borisdayma Jan 27, 2022
90c802b
doc(wandb): add link to documentation
borisdayma Jan 27, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
feat(wandb): add number of items to metadata
  • Loading branch information
borisdayma committed Jan 18, 2022
commit 08ef4de2531acf67e4830e44b0994109211a15d6
1 change: 1 addition & 0 deletions openai/logger.py
Original file line number Diff line number Diff line change
Expand Up @@ -265,6 +265,7 @@ def _log_artifact_inputs(cls, file, prefix, artifact_type, project, entity):
table, n_items = cls._make_table(file_content)
artifact.add(table, stem)
wandb.config.update({f"n_{prefix}": n_items})
artifact.metadata["items"] = n_items
except:
print(f"File {file_id} could not be read as a valid JSON file")

Expand Down