Summary:
This moves BCC to be a git repo in bazel. Note: we need to use it as a git module
because bcc has submodules.

Test Plan: existing

Reviewers: michelle, oazizi, vihang, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8291

GitOrigin-RevId: c8017456e1ae60275906679195e7a862e7fde41d

Summary: TSIA

Test Plan: Build and test all

Reviewers: zasgar, #third_party_approvers, oazizi

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8292

GitOrigin-RevId: a26280785109d0c27d73f1cea0a08442faf4dbdf

Summary:
We are removing private submodules from our repo.

The cpplint version we are using is based off of `d6054228db5daf0a730d627292de75ebb5e04948`

Test Plan: run `arc lint`

Reviewers: vihang, zasgar, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8286

GitOrigin-RevId: e788dd75a2491bd76c9f15b4939c00c6aac9783a

Summary: TSIA

Test Plan: Build and test all

Reviewers: zasgar, michelle, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8284

GitOrigin-RevId: 971711563bb5d7fe1c2b72e6bc951b55ddddfb32

Summary: TSIA

Test Plan: Build and test all in carnot/planner

Reviewers: zasgar, philkuz, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8282

GitOrigin-RevId: 3a20f34383f823a6b7fcde0f88846500486ab45b

Summary: TSIA

Test Plan: Build and test carnot

Reviewers: zasgar, michelle, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8280

GitOrigin-RevId: da62fb47197eeb64200fb1cd995591a287f64d62

Summary: Now that the repos are public we can refer to them using bazel directly instead of private submodules.

Test Plan: existing

Reviewers: vihang, michelle, oazizi, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8283

GitOrigin-RevId: de45a66e6f7a5e53685bc51721b0a4de5b61a0e1

Summary: Now that the repos are public we can refer to them using bazel directly instead of private submodules.

Test Plan: existing

Reviewers: michelle, vihang, oazizi, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8281

GitOrigin-RevId: a0cb8635b8b87dcdf7c2fc4e4f8ef00dbad2ff91

Summary: Now that the repos are public we can refer to them using bazel directly instead of private submodules.

Test Plan: existing

Reviewers: michelle, vihang, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8279

GitOrigin-RevId: 98163b1f8ccfbfc5526603b9c78c860a0957f6d7

Summary:
The aes-min fork looked identical to head. On further investigation,
I realized that we had a patch that was lost in af0405c5fe716a54d38d8c6bf4249e072e642b53

I found the patch in another reflog, so this sets up aes-min as a bazel repo
with a patch.

Test Plan: Build and run //experimental/crypto:gcm_decryptor_test_lib

Reviewers: zasgar, oazizi, #third_party_approvers

Reviewed By: zasgar, oazizi, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8270

GitOrigin-RevId: 6e7c2ecb400bb4443ec6edf10e6bd6dca68f29e9

Summary: TSIA. Now all submodules are located together.

Test Plan: N/A

Reviewers: zasgar, michelle, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8266

GitOrigin-RevId: ee18e0e2f54ef0754a11c364938034c7427f8356

Summary: Move linters and arc plugins for linters into tools

Test Plan: N/A

Reviewers: zasgar, michelle, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8154

GitOrigin-RevId: 76a7af8f71dd27a5fdbbbb992cb0876e389b7dbd

Summary: We basically need to run a one line shell command, so just use that instead.

Test Plan: run chef docker build

Reviewers: vihang, michelle, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8134

GitOrigin-RevId: 6a73d5be828e42a9f8f57c5d266c85723c50f965

Summary:
Trying to cleanup top-level folders.
This moves chef under the tools directory.

Test Plan: N/A

Reviewers: michelle, vihang, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8133

GitOrigin-RevId: 231419eb22fc42c03752cadcf7ed19e15109cc51

Summary:
We used a fork of kuberesolver because of an upstream but. This has been fixed
now so we can switch to using the upstream version.

Test Plan: Vihang tested skaffold vizier.

Reviewers: michelle, vihang, #third_party_approvers

Reviewed By: vihang, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8047

GitOrigin-RevId: e142daa12e653b70dd20d8d7a9405322d2d795ba

Summary: Cleanup some old jank

Test Plan: Run chef

Reviewers: zasgar, #third_party_approvers

Reviewed By: zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D7934

GitOrigin-RevId: c674ffb99346ead29eefb69951a856750e03dc5d

Summary: Cleanup and allow running as not root (atleast on MacOS)

Test Plan: Run chef

Reviewers: zasgar

Reviewed By: zasgar

Subscribers: zasgar

Differential Revision: https://phab.corp.pixielabs.ai/D7899

GitOrigin-RevId: 8906b6baa172608ace2a2940dd5484b1c5393176

Summary: TSIA

Test Plan: N/A

Reviewers: vihang, yzhao, #engineering

Reviewed By: vihang, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D7596

GitOrigin-RevId: f97ce922886b23e78a5d1f7853aaa24c2a078602

Summary:
Reads `go.sum` to check all golang deps. Tries to fetch license from `github.com` and if it fails, tries `pkg.go.dev`.
Reads `.gitmodules` for submodules and tries to fetch licenses from `github.com`.
Uses the npm `license-checker` package to fetch licenses for npm deps.
Reads `repositories.bzl` for other deps and tries to fetch licenses from `github.com`.

Falls back to reading a manual JSON input for deps that we couldn't automatically fetch licenses for.

Test Plan: Run the license fetcher script.

Reviewers: zasgar, philkuz, #engineering, michelle

Reviewed By: philkuz, #engineering, michelle

Subscribers: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D6652

GitOrigin-RevId: a7afed22cc3d65c4a87fd161f0fb1ce5ef619e60

Summary: Starting to look into a DNS protocol parser. Start with an existing simple parser.

Test Plan: None

Reviewers: yzhao, #engineering, zasgar

Reviewed By: #engineering, zasgar

Differential Revision: https://phab.corp.pixielabs.ai/D6436

GitOrigin-RevId: 9ef66a042b168bc1f48f248a45b9d658560b64af

Summary: Restoring the BPFTrace submodule and build.

Test Plan: Manual

Reviewers: yzhao, #engineering

Reviewed By: yzhao, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D6211

GitOrigin-RevId: c4fab9013bda7dd6ea92070da2cb864f430510bd

Summary:
This fixes the following issue related to libtinfo on PEM/Kelvin start:
`libtinfo.so.5: cannot open shared object file: No such file or directory`

When we updated to 20.04, I think I changed the base image but not the active dev image.
This means that we were building all the images using the old ubuntu 18.04.
James noticed a break with skaffold that caused the PEMs to break because of relying on deprecated terminfo5 so he changed our sid deploy dependency to terminfo6. Unfortunately, this broke our deploy images.

I updated the dev images to be ubuntu 18.04, but sadly Clang on that relies on terminfo5 so it's broken with ubuntu 20.04. It's fixable by installing terminfo5, but this might break our code if it links to v5 instead of v6, since we only ship v6.

Updating the old clang install didn't work. clang-9 does not compile with clang-10. Ubuntu 20.04 ships with clang-10 so the compiler can't build our old clang-9 deb with terminfo6...

T...

Summary: Remove docs hosting from pixie and move to netlify. It will make it easier to use their CDN.

Test Plan: Tested using dev cloud on skaffold to verify the redirects.

Reviewers: michelle, philkuz, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D5047

GitOrigin-RevId: 42f5bd8b2c3564e7ea534c5212a39d08a0bf9bdf

Summary:
we recently updated grpc, which slightly changes how it uses Addresses (https://godoc.org/google.golang.org/grpc/resolver#Address)
See: ServerName. it says that if serverName is not empty, that is the name it will use to authenticate with the TLS cert. kuberesolver, the package we're using to resolve kube addresses does not leave this field empty, but rather uses the pod-name, which fails the TLS check. instead, it should be setting this field as "".  patched the kuberesolver library to do that.

Test Plan: ran cloud dev and made sure could login

Reviewers: zasgar, philkuz, #engineering, nserrino

Reviewed By: #engineering, nserrino

Differential Revision: https://phab.corp.pixielabs.ai/D4890

GitOrigin-RevId: fd5f2395c3a2fa5dc22e2d04c32520fe4539d1c0

Summary:
To save memory usage, I have tweaked the ELFIO library:
1) It now has an option to skip loading segments (the sections are all we need).
2) It no longer loads the data of PROGBITS sections, which contain program specific information, including DWARF info. Getting the symbols do not require these sections, which take up a lot of memory.

On one binary, this brought the memory requirements (RSS) from 278 MB down to 63 MB, over 4x memory savings.

Test Plan: Existing tests

Reviewers: zasgar, yzhao, #engineering

Reviewed By: zasgar, #engineering

JIRA Issues: PL-1645

Differential Revision: https://phab.corp.pixielabs.ai/D4016

GitOrigin-RevId: c25b879706e3d31623805c08cc5b1bbee8883685

Summary: It's moved to pixie-docs.

Test Plan: N/A

Reviewers: michelle, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D3764

GitOrigin-RevId: 77aafb9c8ca8c8bdc759ec4e4cd3bc9cfc215e4b

Summary:
Customer docs moved to github repo and submodule added.
This will allow contractors to contribute the github repo.

Test Plan: N/A

Reviewers: michelle, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D3472

GitOrigin-RevId: 68b02bc160c803b0f434c05515bccb2eb14ecdaf

Summary:
With TLS, when we capture keys with uprobes, we actually get the expanded round keys.
For example, there are 11*16B such keys for AES-128.

But these keys are hard to use with existing crypto libraries, since their interface generally wants
the master key.

This diff includes a modified aes-min submodule. The aes-min has been modified to incorporate
a reverse key generator that goes from the expanded round keys back to the original key.

Next step is to use the recovered master key to show a proof-of-concept that we can decrypt captured traces.

Test Plan: A couple of AES-min tests added to show how the key recovery works.

Reviewers: zasgar, yzhao, #engineering

Reviewed By: zasgar, yzhao, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D2656

GitOrigin-RevId: 48c809a1e7b85f7597f4948f034af5320960961c

Summary: This is a forked version with some enhancements to produce better traces.

Test Plan: None yet.

Reviewers: michelle, oazizi, #engineering

Reviewed By: oazizi, #engineering

JIRA Issues: PL-795

Differential Revision: https://phab.corp.pixielabs.ai/D2568

GitOrigin-RevId: 823a820fc85aabf29b7d46c1d1d5b28007d158ce

Summary: adding our local copy of glice to the repo to use in license generating scripts

Test Plan: `bazel run @com_github_ribice_glice//:glice`

Reviewers: zasgar, michelle, #engineering

Reviewed By: michelle, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D2220

GitOrigin-RevId: 2df7efd68f6fff3054e7d98554e1d454facc77ff

Summary:
The reason that it cannot be adapted as nghttp2, is that we need to change a piece of code
that is deep in the chain of DescriptorDatabase, DynamicMessage, DescriptorProto.

We'll need to replace DynamicMessage with our own version, and and reimplement DescriptorDatabase to
return that new class, that will be too much work and fragile to breakage as we'll duplicate a lot
of code.

Test Plan: Jenkins

Reviewers: #engineering, oazizi, zasgar

Reviewed By: #engineering, oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D1742

GitOrigin-RevId: eb0debd44a97be5bb14598eece0f4cc0e0c75edf

Summary:
This makes it easier for us to move the build to libc++, because
it allows build flags to be seamlessly used by the BCC build.

Test Plan: Jenkins

Reviewers: oazizi, yzhao, #engineering

Reviewed By: oazizi, yzhao, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D1044

GitOrigin-RevId: f8cf302795b7dab9b00a33fd72a1ca97cce607f2

Summary: We don't currently use bpftrace and connectors and it's make the move to libc++ complicated.

Test Plan: Jenkins

Reviewers: oazizi, yzhao, #engineering

Reviewed By: oazizi, yzhao, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D1042

GitOrigin-RevId: b665e703c62803297332d00014201daef5d45b02

Summary:
Point to a private form of tdigest code.
This is used for quantiles (coming soon).

Test Plan: N/A

Reviewers: michelle, oazizi, #engineering

Reviewed By: oazizi, #engineering

Differential Revision: https://phab.corp.pixielabs.ai/D439

GitOrigin-RevId: e4baf00e4e92d9cee449e583cf14414e00e911da

Summary: Add a submodule for bpftrace, and modify the build system to build it.

Test Plan: Count on phabricator to catch any build issues!

Reviewers: #engineering, zasgar

Reviewed By: #engineering, zasgar

Differential Revision: https://phab.corp.pixielabs.ai/D292

GitOrigin-RevId: 6fce53a1c509dd9511f03de60b727b94d59a5440

Summary: This is updating the pointer to the latest version by oazizi. I need the change for a change I am working on.

Test Plan: N/A

Reviewers: #engineering, oazizi, michelle

Reviewed By: #engineering, michelle

Differential Revision: https://phab.corp.pixielabs.ai/D251

GitOrigin-RevId: 951ae3d2bff01f7668c27d960fc298cdb60f8688

Summary: Added as a submodule since it's our private fork.

Test Plan:
```
cd throwaway
bazel build :pypa_demo
../bazel-bin/throwaway/pypa_demo <python file>
```

Reviewers: #engineering, michelle

Reviewed By: #engineering, michelle

Differential Revision: https://phab.corp.pixielabs.ai/D194

GitOrigin-RevId: bc1ba537d08dac4c996c58dd7504a4668668733a

Summary: Adding Apache Arrow to Bazel to prepare for when we need to use it

Test Plan: bazel build :hello_arrow

Reviewers: zasgar, kgandhi

Reviewed By: zasgar

Differential Revision: https://phab.corp.pixielabs.ai/D177

GitOrigin-RevId: ab55c191c0ba0f211e3f09e6f87580ba05e80474

Summary: This also updates cpplint and adds support for things like "#pragma once".

Test Plan: Jenkins

Reviewers: #engineering, michelle

Reviewed By: #engineering, michelle

Differential Revision: https://phab.corp.pixielabs.ai/D160

GitOrigin-RevId: 5d08f6d6d0b12027fb3cb27966144f393029790b

Summary:
Contains a set of recipes to provision our machines. There are primiarly three different roles that can be provisioned:

pl_base_dev -- Has everything to run builds.
pl_workstation -- Has the recipes to setup a full dev workstation.
pl_desktop -- Has all gui apps.

One thing left to debug is why our new images are bit bigger:

Original:
gcr.io/pl-dev-infra/base_dev_image          201811061534        36a879b7aa10        2 weeks ago         2.26GB

New:
gcr.io/pl-dev-infra/base_dev_image          201811270026        7ac725b2098b        10 hours ago        2.43GB

And the delta with the dev image (there should be no delta right now):
gcr.io/pl-dev-infra/dev_image               201811271012        5fa2b90382ed        25 minutes ago      2.85GB

Docs here: https://phab.corp.pixielabs.ai/w/eng/machine_provisioning/

Test Plan:
  Tested on Linux VM to ensure proper setup.
  Tested on Mac.
  Crated docker images using `make build_and_push_base_dev_image` and `make build_and_push_dev_images`

Reviewers: #engineering, michelle, philkuz

Reviewed By: philkuz

Subscribers: kgandhi, philkuz

Differential Revision: https://phab.corp.pixielabs.ai/D131

GitOrigin-RevId: 3ad87c10fe426c7a5f565c76370f89c0243ed164