Summary: This should work again.

Test Plan: Image builds.

Reviewers: zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8462

GitOrigin-RevId: 27c59fd4a6edb879444e6753b2305e3f2c80b4b2

Summary: Adds antlr4 jar installation to chef.

Test Plan: ran chef locally and it worked.

Reviewers: zasgar, nserrino, michelle

Reviewed By: michelle

Subscribers: vihang

JIRA Issues: PP-2658

Differential Revision: https://phab.corp.pixielabs.ai/D8379

GitOrigin-RevId: b75af2621e93c55f9e361f21957449f5b4515d49

Summary:
Make our images public to allow external users to build artifacts. All of the code is
publically released so no reason to keep the images private.

Test Plan: build without creds

Reviewers: oazizi, michelle, vihang, jamesbartlett, #third_party_approvers

Reviewed By: oazizi, vihang, #third_party_approvers

JIRA Issues: PP-2628

Differential Revision: https://phab.corp.pixielabs.ai/D8314

GitOrigin-RevId: 8f122e017eabc557c7526526a71d6680cb6e2664

Summary: We basically need to run a one line shell command, so just use that instead.

Test Plan: run chef docker build

Reviewers: vihang, michelle, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8134

GitOrigin-RevId: 6a73d5be828e42a9f8f57c5d266c85723c50f965

Summary:
Trying to cleanup top-level folders.
This moves chef under the tools directory.

Test Plan: N/A

Reviewers: michelle, vihang, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8133

GitOrigin-RevId: 231419eb22fc42c03752cadcf7ed19e15109cc51

Summary: TSIA

Test Plan: Existing

Reviewers: vihang, oazizi

Reviewed By: vihang, oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D7605

GitOrigin-RevId: b588cc05f38c2e26282d1b64db6c6dc9d08a57c7

Summary: Will remove the incompatibility flags soon.

Test Plan: N/A

Reviewers: vihang, michelle, #engineering

Reviewed By: vihang, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D7602

GitOrigin-RevId: 60d5525eb0bdb8b5501d484fa5b92451f7525beb

Summary: TSIA

Test Plan: Existing

Reviewers: michelle, vihang, oazizi, #engineering

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D7592

GitOrigin-RevId: 2eabe757ed8dc256e21df6ff26ccadb11725fed9

Summary: TSIA

Test Plan: Tested striling as well. Thanks Omid for the fix.

Reviewers: vihang, oazizi, michelle, #engineering

Reviewed By: vihang, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D7137

GitOrigin-RevId: 93aa01cc235fa75b3394f1ca94801fba52670a2f

Summary:
We need cross compiled libraries not just ARM and WASM targets. Going to add those in but want to
prevent taking up too much space by having LLVM built with those targets as well.

Test Plan: Existing.

Reviewers: michelle, vihang, oazizi, #engineering

Reviewed By: vihang, oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D6684

GitOrigin-RevId: 43ce258954da79b6f02cc7be6a4250b7801f8dbc

Summary: Also purged the base image to reduce size.

Test Plan: Existing

Reviewers: oazizi, vihang, michelle, #engineering

Reviewed By: oazizi, vihang, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D6651

GitOrigin-RevId: f0133a64c495d2360e2c0168dada1c693999b8ef

Summary: tsia

Test Plan: n/a

Reviewers: zasgar, #engineering

Reviewed By: zasgar, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D6318

GitOrigin-RevId: 37f72b8ec54dcebfe74e7247ae3a1396da6a0a4f

Summary: tsia

Test Plan: built the image, ran it in run_docker.sh script and verified that gsutil is in the path

Reviewers: zasgar, #engineering

Reviewed By: zasgar, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D6312

GitOrigin-RevId: 1241ee9ba83d97324519f431179aaa0abab94b9f

Summary:
This fixes the following issue related to libtinfo on PEM/Kelvin start:
`libtinfo.so.5: cannot open shared object file: No such file or directory`

When we updated to 20.04, I think I changed the base image but not the active dev image.
This means that we were building all the images using the old ubuntu 18.04.
James noticed a break with skaffold that caused the PEMs to break because of relying on deprecated terminfo5 so he changed our sid deploy dependency to terminfo6. Unfortunately, this broke our deploy images.

I updated the dev images to be ubuntu 18.04, but sadly Clang on that relies on terminfo5 so it's broken with ubuntu 20.04. It's fixable by installing terminfo5, but this might break our code if it links to v5 instead of v6, since we only ship v6.

Updating the old clang install didn't work. clang-9 does not compile with clang-10. Ubuntu 20.04 ships with clang-10 so the compiler can't build our old clang-9 deb with terminfo6...

This updates the compiler to clang-10 with all the related changes necessary to make sure the code still compiles.

Test Plan:
`bazel test //...` in the docker VM.
`bazel run src/vizier/services/agent:pem_image` in the docker VM.

Reviewers: oazizi, michelle, jamesbartlett, philkuz, #engineering

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D5623

GitOrigin-RevId: a26680e32211f9aec5e42c1349c4cd35015e2213

Summary:
Ubuntu 20.04 is the new LTS image. This will allow us easier upgrades for packages (such as GCC, etc.) moving forward.
This change will require all Linux VMs and machines to update to 20.04.

Test Plan: Docker image, Jenkins.

Reviewers: oazizi, #engineering, yzhao

Reviewed By: #engineering, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D5498

GitOrigin-RevId: 945db80af0725e9193822c3117aecfd77f06f9df

Summary: prototool will help us run checks to determine whether or not any proto changes will break the API

Test Plan: ran the docker image, verified that i can run prototool

Reviewers: zasgar, #engineering

Reviewed By: zasgar, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D4081

GitOrigin-RevId: 0d53893ef5c67b8b724fc5f1ae3b7554b71c639f

Summary:
Update nodejs.

We needed to pull in a new base image due to an old version of node installed on it.
Something upstream changed which broke the original update-rc.d command which is why
we have additional changes.

Fix style

Test Plan: Jenkins

Reviewers: oazizi, michelle, #engineering

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D4020

GitOrigin-RevId: 383ab4d5ea45bcf1636dce2a1d511aa2ed775eaf

Summary: This is needed to use stan.go and nats.go (since they end with a .go suffix which is bugged out in older builds).

Test Plan: `bazel test //...`

Reviewers: michelle, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D3639

GitOrigin-RevId: f4aa80623d8533541f4d16fb6b063f1ea37bb6cf

Summary: This updates to clang-9 and also updates our llvm build to use 9.0

Test Plan: `bazel test //...` and jenkins.

Reviewers: oazizi, #engineering

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D2235

GitOrigin-RevId: 1bfc34c0d46fadca0a1c3f53f2ac9a675e9795c4

Summary:
Need a newer version of go for some skaffold packages.
I needed to download skylib because of a incompatibility. Will upgrade that when fixed.

Fix lint

Test Plan: `bazel test //...`

Reviewers: oazizi, michelle, #engineering, philkuz

Reviewed By: oazizi, #engineering, philkuz

Differential Revision: https://phab.corp.pixielabs.ai/D1894

GitOrigin-RevId: c5fd227de120aed83f2c67c9e85b56eb1bcec0be

Summary: Java license changes broke our Oracle JDK PPA.

Test Plan: Jenkins

Reviewers: oazizi, #engineering, chengruizhe

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D925

GitOrigin-RevId: 3e18ae352f94d9da8d109b850c21d7f539b5d551

Summary: Base image will be updated on jenkins workers, for faster fetches.

Test Plan: Jenkins

Reviewers: #engineering, oazizi, michelle

Reviewed By: #engineering, michelle

Differential Revision: https://phab.corp.pixielabs.ai/D323

GitOrigin-RevId: d94b19b03030c45501ee36f8d891574894d9e3b4

Summary: Added MSAN and ASAN builds. MSAN is not on Jenkins yet because it needs a custom libc++ (we can defer this to later).

Test Plan: Jenkins build.

Reviewers: michelle, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D139

GitOrigin-RevId: 749f238eaa672406dfc52cba80f4a7a3bac765e2

Summary:
This reduces our need to depend on LLVM 6.0.
Also, removed the bcc_dev_docker image upload which is not necessary.

Test Plan: Jenkins

Reviewers: #engineering, philkuz, kgandhi

Reviewed By: #engineering, kgandhi

Differential Revision: https://phab.corp.pixielabs.ai/D138

GitOrigin-RevId: fe160a0871b8832769c0778b92bf37c1ae431993

Summary: TSIA

Test Plan: Jenkins

Reviewers: #engineering, michelle

Reviewed By: #engineering, michelle

Differential Revision: https://phab.corp.pixielabs.ai/D137

GitOrigin-RevId: 8354b5a4d2411a6a69679976980ffcd66fb87d08

Summary:
Contains a set of recipes to provision our machines. There are primiarly three different roles that can be provisioned:

pl_base_dev -- Has everything to run builds.
pl_workstation -- Has the recipes to setup a full dev workstation.
pl_desktop -- Has all gui apps.

One thing left to debug is why our new images are bit bigger:

Original:
gcr.io/pl-dev-infra/base_dev_image          201811061534        36a879b7aa10        2 weeks ago         2.26GB

New:
gcr.io/pl-dev-infra/base_dev_image          201811270026        7ac725b2098b        10 hours ago        2.43GB

And the delta with the dev image (there should be no delta right now):
gcr.io/pl-dev-infra/dev_image               201811271012        5fa2b90382ed        25 minutes ago      2.85GB

Docs here: https://phab.corp.pixielabs.ai/w/eng/machine_provisioning/

Test Plan:
  Tested on Linux VM to ensure proper setup.
  Tested on Mac.
  Crated docker images using `make build_and_push_base_dev_image` and `make build_and_push_dev_images`

Reviewers: #engineering, michelle, philkuz

Reviewed By: philkuz

Subscribers: kgandhi, philkuz

Differential Revision: https://phab.corp.pixielabs.ai/D131

GitOrigin-RevId: 3ad87c10fe426c7a5f565c76370f89c0243ed164