profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/vanpelt/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.
Chris Van Pelt vanpelt crowdflower.com San Francisco wandb.com

lukas/ml-class 1713

Machine learning lessons and teaching projects designed for engineers

full-stack-deep-learning/fsdl-text-recognizer-project 1037

The source repository is at https://github.com/full-stack-deep-learning/fsdl-text-recognizer

stripe/rainier 415

Bayesian inference in Scala.

lukas/robot 160

Simple library for controlling a raspberry pi based robot

full-stack-deep-learning/fsdl-text-recognizer 54

Repo that generates https://github.com/full-stack-deep-learning/fsdl-text-recognizer-project

machine-learning-apps/wandb-action 38

GitHub Action That Retrieves Model Runs From Weights & Biases

vanpelt/dm-imap-adapter 14

An IMAP adapter for DataMapper. Supports reading, writing, updating... the whole works.

bpo/resque 11

A simple Redis-based queue.

vanpelt/delayed_job 8

Database backed asynchronous priority queue -- Extracted from Shopify

push eventwandb/client

Chris Van Pelt

commit sha 52f43123bee86de05f4c7bbe55b9932845e4e64d

More tests less code

view details

push time in 17 minutes

push eventwandb/client

Chris Van Pelt

commit sha e51e9016249b6097a6ef364cde138735e0d10a42

[WB-6473] Support for embedding runs, sweeps, and reports with new MAGIC (#2650)

view details

Jeff Raubitschek

commit sha 12b86f782dcf50353edbbc95636f20c6c49e3136

Use pinned sweep_engine (not latest) (#2679)

view details

Jeff Raubitschek

commit sha 6a4b52a823cb303606d308826c28c0ff28d64149

Update mock server to yea-wandb 0.7.15 (#2684)

view details

Danny Goldstein

commit sha 6b0e463235c291bf08f84847b2726dcc7c652087

make run.State read only in the public api (#2687)

view details

Danny Goldstein

commit sha 2e74e5ed7c3bc9b0a87c2d577cece581f1be3537

Remove submodules from client (#2667)

view details

Danny Goldstein

commit sha 043a5c43264c81cb0015c911993fd63666c11219

[WB-6698] Fix grid search stopping condition in local controller (#2689)

view details

Danny Goldstein

commit sha 957f93c43eb8e5b0f51fabf3b47c362bce25389e

make api key prompting be more captive (#2688)

view details

Chris Van Pelt

commit sha f7a74e8ee13a0e18a3166988ef3e3eaf3dab1115

Merged master

view details

Chris Van Pelt

commit sha f60634e03e1d369c07481166b732fdb450faa87c

UI_URL => APP_URL, just blowup on invalid url

view details

push time in 2 hours

issue commentwandb/client

[Q] Python API runs, filter by tags

You bet! Yeah, we can do a better job documenting examples and have plans to make a more intuitive python helper to construct filters.

abaisero

comment created time in a day

issue closedwandb/client

[Q] Python API runs, filter by tags

Hello,

I'm using the python API to download the data associated with my runs (using wandb.Api().runs(...), so that I can make my own custom plots. The examples I've found have covered how to filter based on config values, but I found nothing explaining how to filter based on tag values (or if it is even possible), like it is possible in the dashboard UI. For the time being, I will proceed by downloading all the data associated with all the tags, and applying a filter locally, but that seems like a wasteful usage of bandwidth, both mine and wandb's.

Is there currently a way to apply a filter based on tag values? If there is not, I will reopen this as a feature request.

Thank you!

closed time in a day

abaisero

issue commentwandb/client

[Q] Python API runs, filter by tags

runs = api.runs("username/project", filters={"tags": {"$in": ["best"]}})

abaisero

comment created time in a day

issue commentwandb/client

[CLI] wandb sync fails to upload reports from crashed scripts (AssertionError)

@MoritzTaylor can you provide a debug-internal.log from a run that's failing to sync? If you could also share the .wandb file that would help us reproduce and debug this. You can send it to vanpelt@wandb.com

piraka9011

comment created time in a day

issue closedwandb/client

Roll back from local to cloud

I had wandb working on cloud. Then I switched to local, and got "Retry attempt failed:" error. I tried to switch back from local to cloud, but it seems that my system got stuck at wandb/local model. Trying to "docker stop wandb/local", and ran the code again. I am still getting the error:

TensorBoard: Start with 'tensorboard --logdir yolov5', view at http://localhost:6006/ wandb: Network error (ConnectionError), entering retry loop.

How do I switch the model to cloud to view training metrics at "wandb.ai/home".

Thanks, C. Chien

closed time in 2 days

chyphen7

issue commentwandb/client

Roll back from local to cloud

Yep! @chyphen7 you can also run wandb login --cloud to configure the whole machine to use https://api.wandb.ai. If you then want to switch back to your local instance you would run wandb login --host=http://localhost:6006.

chyphen7

comment created time in 2 days

issue commentwandb/local

Local Server points to localhost when trying to download artifacts

You should configure a load balancer in front of the container and configure DNS. You're also risking data loss by not licensing and connecting external MySQL and S3 storage. All that being said, you likely want to update the Host setting at /system-admin to point to your external IP instead of localhost.

serchu

comment created time in 3 days

issue commentwandb/client

[CLI] Permission denied: '/users' on remote cluster from `wandb agent`

Hey @tom-andersson wandb login API_KEY writes the credentials to the current users home directory. If the wandb agent is being run as a different user it can't pick up these creds. The simplest fix is likely to specify the API_KEY as an environment variable: WANDB_API_KEY=<api-key> wandb agent <username/project/agent-id>

tom-andersson

comment created time in 3 days

push eventwandb/client

Chris Van Pelt

commit sha 92268438161220a917418f69e7758cf3551ca358

Fix formatting

view details

push time in 3 days

PR opened wandb/client

Task verify fixes

https://wandb.atlassian.net/browse/WB-6576

Description

wandb verify doesn't work if a user has an "internal://" BUCKET_QUEUE. This works to fix that.

Testing

How was this PR tested?

Release Notes

Below, please enter user-facing release notes as one or more bullet points. If your change is not user-visible, write NO RELEASE NOTES instead, with no bullet points.

------------- BEGIN RELEASE NOTES ------------------

  • wandb verify properly validates instances with an "internal://" BUCKET_QUEUE ------------- END RELEASE NOTES --------------------
+28 -56

0 comment

2 changed files

pr created time in 3 days

create barnchwandb/client

branch : task/verify-fixes

created branch time in 3 days

issue commentwandb/client

[CLI] wandb sync fails to upload reports from crashed scripts (AssertionError)

@MoritzTaylor what version of wandb are you using wandb --version?

piraka9011

comment created time in 3 days

PullRequestReviewEvent

issue commentwandb/client

[CLI] `ImportError: cannot import name '_get_mock_module' from 'pytest_mock'`

@samuela I just cut a new branch that should handle the newer pytest-mock versions. You can try it now with:

pip install --upgrade git+git://github.com/wandb/client.git@task/pytest-mock#egg=wandb

It should go out in the official release next week.

samuela

comment created time in 4 days

PR opened wandb/client

[CLI-2682] Handle newer pytest-mock versions

https://github.com/wandb/client/issues/2682

Description

Handles newer versions of pytest-mock for customers including wandb in their CI pipelines.

Testing

How was this PR tested?

Release Notes

Below, please enter user-facing release notes as one or more bullet points. If your change is not user-visible, write NO RELEASE NOTES instead, with no bullet points.

------------- BEGIN RELEASE NOTES ------------------ NO RELEASE NOTES ------------- END RELEASE NOTES --------------------

+7 -1

0 comment

1 changed file

pr created time in 4 days

create barnchwandb/client

branch : task/pytest-mock

created branch time in 4 days

issue commentwandb/client

[CLI] ~/.cache directory unbounded in size

It's officially supported!

dlangerm

comment created time in 4 days

issue commentwandb/client

[CLI] ~/.cache directory unbounded in size

Hey @dlangerm we have plans to automatically cleanup this cache. Until then we do provide a command. You can run the following:

wandb artifact cache cleanup 10GB

This will remove the most stale objects from the cache keeping only 10GB of the most recently accessed objects.

dlangerm

comment created time in 4 days

issue commentwandb/local

Container enter crash loop when machine restarts

Yeah, this is a known issue with the way docker does restarts. You should be able to run the container as system level service that should handle hard restarts. This blog has some good examples.

opsxcq

comment created time in 4 days

PullRequestReviewEvent

issue commentwandb/client

[CLI] ModuleNotFoundError: No module named 'wandb.integration'; 'wandb' is not a package

Hey @roboserg not shameful, it's happened to me a few times and always makes me scratch my head.

For the tensorboard sync issue, can you share a link to a run that was created by this code? I want to confirm if the tensorboard files are getting uploaded to wandb.

This shouldn't make a difference but you can scope our tensorboard syncing to a specific logdir. This would only matter if you were creating a number of different tfevent files in the logdir which I doubt is the case.

id = wandb.util.generate_id()
logdir = f"runs/{id}"
wandb.tensorboard.patch(root_logdir=logdir)
run = wandb.init(
    project="sb3",
    id=id,
    config=config,
    monitor_gym=True,  # auto-upload the videos of agents playing the game
    save_code=True,  # optional
)
roboserg

comment created time in 5 days

issue commentwandb/client

[CLI] `ImportError: cannot import name '_get_mock_module' from 'pytest_mock'`

Hey @samuela our dev environment currently requires pytest-mock<=3.2.0. Are you able to install 3.2.0?

samuela

comment created time in 5 days

issue closedwandb/client

[CLI] ModuleNotFoundError: No module named 'wandb.integration'; 'wandb' is not a package

Code from the Basic Example from here https://gitbook-docs.wandb.ai/guides/integrations/other/stable-baselines-3

(fastchan) E:\DeepLearning\RLgym>python wandb.py
Traceback (most recent call last):
  File "wandb.py", line 5, in <module>
    import wandb
  File "E:\DeepLearning\RLgym\wandb.py", line 6, in <module>
    from wandb.integration.sb3 import WandbCallback
ModuleNotFoundError: No module named 'wandb.integration'; 'wandb' is not a package

If I comment out the 6th line (so only import wandb), still an error:

(fastchan) E:\DeepLearning\RLgym>python wandb.py
Traceback (most recent call last):
  File "wandb.py", line 5, in <module>
    import wandb
  File "E:\DeepLearning\RLgym\wandb.py", line 14, in <module>
    run = wandb.init(
AttributeError: partially initialized module 'wandb' has no attribute 'init' (most likely due to a circular import)

closed time in 5 days

roboserg

issue commentwandb/client

[CLI] ModuleNotFoundError: No module named 'wandb.integration'; 'wandb' is not a package

The error is being caused by the python import system thinking that you want to import the wandb.py file when you run import wandb. Just change the name of your script from wandb.py to train.py or main.py anything other than wandb.py.

roboserg

comment created time in 5 days

issue commentwandb/client

AttributeError: partially initialized module 'wandb' has no attribute 'data_types' (most likely due to a circular import)

Can you try adding import wandb at the top of your file? If that doesn't work, please provide a traceback.

sumalatha8280

comment created time in 6 days

issue commentwandb/local

RequestError (500): send request failed (original: Get "http://127.0.0.1:9000/local-files/yang***/*****/3k2xr8hc/wandb-metadata.json": dial tcp 127.0.0.1:9000: connect: connection refused)

@JieGenius this indicates that the minio object store running inside of the container is not accepting connections. I would try restarting the container. If that doesn't work, you can exec into the container and see if there are any details in the following log file: /var/log/minio.log

JieGenius

comment created time in 6 days

issue commentwandb/client

[Enhancement] CatBoost support in W&B

@thunderock we used to have this in the mainline, but it got dropped as we were upgrading the library. We'll try to get it back in, but you take the old code and add it to your own library until it makes it back in:

https://github.com/wandb/client/blob/v0.9.5/wandb/catboost

neomatrix369

comment created time in 9 days

push eventwandb/client

Chris Van Pelt

commit sha c85541ec418c08ce63aa655749ae13c624cff5fa

Add viewer property, fix tests

view details

push time in 9 days