werkt ( George Gensure )

add "worker capabilities" for future support of storage workers

We are implementing "storage workers"- which are workers that contribute to the sharded CAS, but do not participate in execution.
To achieve this, we add a worker configuration for opting out of execution. We've discussed simplifying these changes into a configuration called "capabilities". Capabilities will be used to help us distinguish the type of workers we have.
Here is how we would determine our current worker types:

CAS	Execution	Type
true	true	Cpu
false	true	Gpu
true	false	Storage

+24 -8

1 commit in bazelbuild/bazel-buildfarm/tree/luxe/add_capabilities bazelbuild/bazel-buildfarm/tree/master

0 comment

3 changed files

pr created time in a day

create barnchbazelbuild/bazel-buildfarm

branch : luxe/add_capabilities

created branch time in a day

issue commentbazelbuild/bazel-buildfarm

Unable to start server on macOS using tutorial

Edited .bazelversion to use 4.1.0 then verified version.

cobbler-laptop01:bazel-buildfarm loyaltyarm$ bazel --version
bazel 4.1.0

Ran bazel clean with --expunge.

cobbler-laptop01:bazel-buildfarm loyaltyarm$ bazel clean --expunge
INFO: Starting clean.

Re-ran the run command from quick start:

cobbler-laptop01:bazel-buildfarm loyaltyarm$ bazel run src/main/java/build/buildfarm:buildfarm-server $PWD/examples/server.config.example
Starting local Bazel server and connecting to it...
ERROR: /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/jdk/BUILD:490:6: Configurable attribute "actual" doesn't match this configuration: Could not find a JDK for host execution environment, please explicitly provide one using `--host_javabase.`
INFO: Repository googleapis instantiated at:
  /Users/loyaltyarm/src/bazel-buildfarm/WORKSPACE:5:23: in <toplevel>
  /Users/loyaltyarm/src/bazel-buildfarm/deps.bzl:99:14: in buildfarm_dependencies
  /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/build_defs/repo/utils.bzl:201:18: in maybe
Repository rule http_archive defined at:
  /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/build_defs/repo/http.bzl:336:31: in <toplevel>
INFO: Repository 'googleapis' used the following cache hits instead of downloading the corresponding file.
 * Hash '745cb3c2e538e33a07e2e467a15228ccbecadc1337239f6740d57a74d9cdef81' for https://github.com/googleapis/googleapis/archive/6598bb829c9e9a534be674649ffd1b4671a821f9.zip
If the definition of 'googleapis' was updated, verify that the hashes were also updated.
INFO: Repository remote_java_tools_darwin instantiated at:
  /DEFAULT.WORKSPACE.SUFFIX:245:6: in <toplevel>
  /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/build_defs/repo/utils.bzl:201:18: in maybe
Repository rule http_archive defined at:
  /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/build_defs/repo/http.bzl:336:31: in <toplevel>
ERROR: Analysis of target '//src/main/java/build/buildfarm:buildfarm-server' failed; build aborted: /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/bazel_tools/tools/jdk/BUILD:490:6: Configurable attribute "actual" doesn't match this configuration: Could not find a JDK for host execution environment, please explicitly provide one using `--host_javabase.`
INFO: Elapsed time: 14.933s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (36 packages loaded, 558 targets configured)
FAILED: Build did NOT complete successfully (36 packages loaded, 558 targets configured)
    currently loading: src/main/protobuf
    Fetching @local_config_xcode; fetching
    Fetching ...806cca4ca57a45150c2d667271a4b/external/googleapis; Extracting /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/googleapis/temp2138561162632920666/6598bb829c9e9a534be674649ffd1b4671a821f9.zip
    Fetching @rules_proto; fetching
    Fetching ...4ca57a45150c2d667271a4b/external/rules_proto; Extracting /private/var/tmp/_bazel_loyaltyarm/073806cca4ca57a45150c2d667271a4b/external/rules_proto/temp15113028073105299790/40298556293ae502c66579620a7ce867d5f57311.tar.gz

loyaltyarm

comment created time in 2 days

pull request commentbazelbuild/bazel-buildfarm

Update external repository instructions

This might be better handled in defs.bzl . WDYT ? Happy to modify and test if that's a better way to do it.

gabware

comment created time in 2 days

PR opened bazelbuild/bazel-buildfarm

Update external repository instructions

Add a call to compat_repositories() when configuring bazel-buildfarm as an external repository. Without this bazel fails building the buildfarm-server with the following error:

ERROR: [...]/bzl-ws/external/io_grpc_grpc_java/compiler/BUILD.bazel:18:13: no such package '@com_google_guava_guava//jar': The repository '@com_google_guava_guava' could not be resolved and referenced by '@io_grpc_grpc_java//compiler:java_grpc_library_deps__do_not_reference'

TESTED=build and ran buildfarm-server and buildfarm-operationqueue-worker on windows host.

+4 -0

1 commit in gabware/bazel-buildfarm/tree/master bazelbuild/bazel-buildfarm/tree/master

0 comment

1 changed file

pr created time in 2 days

delete branch bazelbuild/bazel-buildfarm

delete branch : luxe/metrics_for_dispatched

delete time in 4 days

push eventbazelbuild/bazel-buildfarm

Trevor Hickey

commit sha 04583ec6ccd26ca97532939873a4b03aa8252c32

[configuration] fix misuse of getProcessingTimeoutMillis (#713)