When a new pull request is opened in the project and the author of the pull request is not a member of the RobotLocomotion GitHub organization, the Jenkins GitHub Pull Request Builder @drake-jenkins-bot will not automatically schedule builds.
To allow the pull request to be tested, a member of the RobotLocomotion organization may comment:
@drake-jenkins-bot ok to test
to accept this pull request for testing.@drake-jenkins-bot test this please
for a one time test run.
If the build fails for other various reasons you can rebuild:
@drake-jenkins-bot retest this please
to start a new build.
You can also view the Jenkins UI directly.
Rebuilding via Reviewable
When posting a @drake-jenkins-bot ... please
comment in Reviewable,
never use the large green “Publish” button in the upper right corner.
Instead, write the bot comment in the “Review discussion” box immediately below the “File Matrix” widget and use the “single message send” button to post it, in the lower-right corner of the “Review discussion” box.
(For details, see Reviewable#576.)
Scheduling an On-Demand Build
There are a number of Jenkins builds that do not normally run pre-merge, but do
run post-merge or nightly. These builds include lower-priority
platforms (e.g., macOS), and specialized options (e.g.,
UndefinedBehaviorSanitizer).
Members of the RobotLocomotion organization can manually schedule these builds
on pull requests that have not yet been merged, or on arbitrary commits in the
RobotLocomotion/drake
repository.
To schedule a build of an open pull request merged with master, comment:
@drake-jenkins-bot <job-name> please
where <job-name>
is the name of an
experimental job.
For example:
@drake-jenkins-bot mac-arm-sonoma-clang-bazel-experimental-release please
@drake-jenkins-bot linux-jammy-clang-bazel-experimental-valgrind-memcheck please
A list of Jenkins bot commands that cover the full set of continuous and nightly production jobs are available for provisioned and unprovisioned builds.
Scheduling Builds via the Jenkins User Interface
Alternatively, to schedule a build of an open pull request or arbitrary commit
in the RobotLocomotion/drake
repository:
- Log in to Jenkins using GitHub OAuth. (Make sure that you see your name the upper-right corner, not the words “Log in”.)
- Go to the list of experimental builds.
- Click on the specific build you want to schedule.
- Click on “Build with Parameters” in the left menu.
- Enter
pr/XYZ/head
(HEAD of pull request),pr/XYZ/merge
(pull request merged with master), or the desired commit SHA in thesha1
field. - Click
Build
.
The list of experimental builds includes builds that automatically run on opened and updated pull requests, as well as numerous other builds for on-demand use. To help identify the on-demand build you want to run, you can consult the lists of continuous, and nightly but you should not schedule continuous or nightly builds directly.
Updating Installation Prerequisites
Installation prerequisites are packages that are not pulled in Bazel, but
instead installed on the OS itself using a package manager like apt
,
Homebrew, or pip
(only on Mac). They are installed via the scripts under
setup/
, and are split between binary_distribution
(dependencies that
are necessary for binary installation) and
source_distribution
(dependencies, in addition to those in
binary_distribution
, necessary for
source installation). Since
source_distribution
will also install prerequisites in
binary_distribution
, you do not need to duplicate binary prerequisites in
source_distribution
.
Prerequisites of the source_distribution
are further split into three
parts: those that are needed for building and running the //:install
target
using bazel
(bazel run //:install
), those additional dependencies for
building and running tests (bazel test ...
), and those additional
dependencies for running select maintainer scripts (e.g., mirror_to_s3.py
and new_release.py
). Again, it is expected that a given prerequisite will
only appear in one of these lists.
When updating prerequisites with these scripts, the normal experimental CI will most likely fail. To test new prerequisites, you should first request unprovisioned experimental builds, e.g.:
@drake-jenkins-bot linux-jammy-unprovisioned-gcc-bazel-experimental-release please
@drake-jenkins-bot mac-arm-sonoma-unprovisioned-clang-bazel-experimental-release please
After this has passed, go through normal review. Once normal review is done,
add @BetsyMcPhail
for review and request that the provisioned instances be
updated. She will then respond on when it is appropriate to merge the PR.
Building Packages on Demand
Binary or Debian
To schedule an “experimental” build of a binary package or debian package, comment on an open pull request using one or more of these commands:
@drake-jenkins-bot linux-jammy-unprovisioned-gcc-bazel-experimental-packaging please
@drake-jenkins-bot mac-arm-sonoma-unprovisioned-clang-bazel-experimental-packaging please
or follow the instructions above to schedule a build of one of the Packaging jobs with experimental in its name.
To download the built package, open the Jenkins console log for the completed build (click on “Console Output” then “Full Log”) and search for the text “Upload complete” to find the download URL. For example:
...
[9:49:51 AM] -- Upload complete: https://drake-packages.csail.mit.edu/drake/experimental/drake-20230427164706-0b666a17ba2ce3ca7505655dc724960d88a34645-jammy.tar.gz
...
[9:49:53 AM] -- Upload complete: https://drake-packages.csail.mit.edu/drake/experimental/drake-dev_0.0.20230427164706-0b666a17ba2ce3ca7505655dc724960d88a34645-1_amd64-jammy.deb
...
Wheel
To schedule an “experimental” build of a wheel package, comment on an open pull request using one or more of these commands:
@drake-jenkins-bot linux-jammy-unprovisioned-gcc-wheel-experimental-release please
@drake-jenkins-bot mac-arm-sonoma-unprovisioned-clang-wheel-experimental-release please
or follow the instructions above to schedule a build of one of the Wheel jobs with experimental in its name.
To download or install the built wheel, open the Jenkins console log for the completed build (click on “Details” for a wheel build in the pull request’s list of checks, then “Console Output”) and search for the text “Artifacts uploaded to AWS” to find the download URL (usually about a screen’s-worth of text above the end of the log). For example:
...
[12:00:00 AM] -- Artifacts uploaded to AWS:
[12:00:00 AM] https://drake-packages.csail.mit.edu/drake/experimental/drake-0.0.1999.1.1.0.0.0%2Bgitffffffff-cp310-cp310-manylinux_2_31_x86_64.whl
...
Note that there might be multiple wheel files uploaded for different versions
of Python. Be sure to match the Python M.NN
version you will be using to
the -cpMNN-
substring in the URL.
(In some cases, it may be necessary to click the “Full Log” and search for the text “Upload complete”, particularly if you wish to also find the checksum URLs.)
To download the wheel, simply click the link or use your favorite HTTP
retrieval tool (e.g. wget
or curl
).
Wheels may also be installed locally for testing without downloading the wheel as a separate step:
python3 -m venv env
env/bin/pip install --upgrade pip
env/bin/pip install <url-of-experimental-wheel>
source env/bin/activate