Summary:
users should be able to deploy Pixie cloud without requiring our GCS service account credentials.
part of this work required us to make official releases public (see D8484). these releases should be fetchable from GCS without having any credentials.
rcs are still uploaded to our private bucket and will still need credentials to access.

this diff updates the artifact tracker server so that it loads the credentials only if specified. it also changes which bucket it tries to access based on whether or not the desired artifact is an official release

Test Plan:
tested on staging
1. Deleted the service account secret, verified I can still deploy Vizier with official release, update CLI with official release version
2. Redeployed service account secret, verified I can still fetch Vizier/CLI official releases. also verified deploying a vizier rc works

Reviewers: vihang, zasgar

Reviewed By: vihang

JIRA Issues: PC-872

Differential Revision: https://phab.corp.pixielabs.ai/D8485

GitOrigin-RevId: 7316f54727c21c06db3d6b0115a91631f42fb3ea

Summary:
users should be able to deploy Pixie Cloud without needing access to our GCS service account.
to do so, we need to make our official releases public. this diff updates our release build so that official releases are written to our pixie-oss bucket. rcs are still written to our private pixie-prod bucket.

Test Plan:
built some rcs with the buckets switched, to ensure that jenkins had the proper permissions for writing to GCS.
verified that the files were written to the correct bucket. (will delete them now)

Reviewers: vihang, zasgar

Reviewed By: vihang

JIRA Issues: PC-872

Differential Revision: https://phab.corp.pixielabs.ai/D8484

GitOrigin-RevId: b9cbd6dcd26d91d331eccc5ec179f5ae7238c231

Summary:
Currently the vizier-image-secrets are used in two places:
1. In cli deploys, when deploying vizier versions older than 0.5.22
2. In our template generator, which is run during releases.

the vizier-image-secrets are used in the API server's `GetImageCredentials` rpc call which only the CLI deploy calls.
given that we are now on vizier 0.7.2, we can safely clean up the CLI's handling for viziers older than 0.5.22. since this is the only consumer, we can likely also remove the `GetImageCredentials` call itself. for now I've just made the vizier-image-secrets optional, and that call will error if they dont exist.

Test Plan: ran `px deploy`

Reviewers: vihang, zasgar

Reviewed By: vihang

Differential Revision: https://phab.corp.pixielabs.ai/D8486

GitOrigin-RevId: a2144f54d08a444334b54bcabda65d16365a8a3d

Summary: Deflakes the test. Also changes the behavior in that UPIDs that are not in the context will not be pushed to the tables.

Test Plan: Existing tests.

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Subscribers: yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8465

GitOrigin-RevId: 2634af9eb273e29c94502a6ef4afebd73ed4fd07

Summary: this should point to our OSS slackin. we also need to update the docs links once we have our OSS docs ready, since users probably wont be hosting the docs on their own domain.

Test Plan: n/a

Reviewers: vihang, zasgar

Reviewed By: vihang

Differential Revision: https://phab.corp.pixielabs.ai/D8478

GitOrigin-RevId: 7405ea810fe5c1799c4a99dada588564355ada8f

Summary: Small clean-up to the structure, such that we don't have to rely on conn_event_t and close_event_t having the same layout.

Test Plan: Existing tests

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8456

GitOrigin-RevId: cbea73fe9fdccc22e2ef077094f80e8918c5166f

PC-878: Moving oss_auth to ory_auth and clarify docs to show that skaffold can run multiple profiles non-exclusively

Summary: skaffold lets you run multiple profiles so adjusting that. And renaming the oss_auth stuff to ory_auth

Test Plan: deployed dev and ory_auth and it worked as intended.

Reviewers: vihang, michelle

Reviewed By: vihang

JIRA Issues: PC-878

Differential Revision: https://phab.corp.pixielabs.ai/D8477

GitOrigin-RevId: ea737d102c9433f681df04c1d3b5a3aeb2483011

Summary: This reverts commit 6016cb5af425c12dd03635d39abc9bf3b4a19032. Styling was only useful with the rest of the changes.

Test Plan: Tested on yarn dev.

Reviewers: michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8479

GitOrigin-RevId: 791605b25aba343f2762d9bfbe85de2882ccbbbf

Summary: revert

Test Plan: Test on yarn dev, no problems.

Reviewers: michelle, vihang

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8473

GitOrigin-RevId: e30dd8101d65289d8c2955b9d51a9ad2cc3756ae

Summary: These scripts should fail on encountering an error.

Test Plan: N/A

Reviewers: philkuz, zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8475

GitOrigin-RevId: d22eeb178adcd63cc8a4f3f8326741ab803dcba2

Summary: this broke when i made my namespace changes. the kelvin's mds_addr flag is now only a part of the actual mds address. this should have been updated to use the fully constructed version above.

Test Plan: ran skaffold

Reviewers: vihang

Reviewed By: vihang

Differential Revision: https://phab.corp.pixielabs.ai/D8471

GitOrigin-RevId: f240bb9fc5df6323354cffbfa5053275571b84ca

Summary: sign up page gutter was leaking off the div. This fixes it.

Test Plan: yarn dev, style only change

Reviewers: nlanam, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8467

GitOrigin-RevId: 6016cb5af425c12dd03635d39abc9bf3b4a19032

Summary:
TSIA, we overuse aliases especially for the leftover code from
when our proto naming was not consistent.

Now, we can stop aliasing as many things.

Test Plan: Existing build and tests.

Reviewers: zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8466

GitOrigin-RevId: 67e26155006bde8146866b08f49ab7e464135259

Summary: TSIA

Test Plan: Ran `make help`

Reviewers: zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8463

GitOrigin-RevId: b8b8dc5c409122b324e61511056bfb3e2a3cfea5

Summary: This should work again.

Test Plan: Image builds.

Reviewers: zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8462

GitOrigin-RevId: 27c59fd4a6edb879444e6753b2305e3f2c80b4b2

Summary: Remove those trackers ReadyForDestruction from the list of trackers, but wait for enough expired trackers to pay the cost of iteratiing and modifying the map.

Test Plan: Existing tests

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Subscribers: jps, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8411

GitOrigin-RevId: da8e9196ccf4bcc6780eed0abca91d7e7f152d38

Summary: Needs a space.

Test Plan: Manual

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8458

GitOrigin-RevId: 75c2dd5335898238e14697c75dde8de652cc7dfb

Summary:
--sources is repurposed to accept source names
--source_group is added to work as the old --sources flag.

Test Plan: Manual run stirling_wrapper

Reviewers: #stirling, oazizi

Reviewed By: #stirling, oazizi

Subscribers: oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D8438

GitOrigin-RevId: 64308654966efe780996d9d10a76b46a6ee5d18a

Summary:
This helps quickly identify the logical connection from k8s entities
to records.

Test Plan: Manually run

Reviewers: #stirling, #engineering, philkuz

Reviewed By: #engineering, philkuz

Differential Revision: https://phab.corp.pixielabs.ai/D8461

GitOrigin-RevId: f9c8e2d02a555f63f720cfc792d9b0b1d8c18bd1

Summary:
This diff sets up user/password for Auth0. Created a new button, use the [[ https://auth0.com/docs/universal-login | Universal Login flow ]], then also needs a signup-complete page that will be redirected from a user's verification link.

Note that we have to add special set up for the auth0 account to make sure this flow is secure. Those are documented in this notion doc: https://www.notion.so/pixielabs/Creating-an-auth0-account-and-setting-up-Pixie-47b6fa663da1495cbad474139c747bea

Some design decisions: Because we block sign-up until verificaton, we cover org solution for now. Eventually we will need better support for creating orgs, likely something that will look more like Slack's model. Because of this design issue, we do not yet have support for inviting users who have already signed up for their own org.

Test Plan: Tested on dev and prod, was able to create a user, get an email verification scheme, then login.

Reviewers: michelle, vjain, nlanam

Reviewed By: michelle

JIRA Issues: PC-863

Differential Revision: https://phab.corp.pixielabs.ai/D8452

GitOrigin-RevId: 1376f2939a6e5bcb9333b34130dc199fac0592e5

Summary: load_dev_db.sh was failing. It turns out we try to end the kubectl port-forward process twice, once with a TERM signal and once with a KILL signal. In the event that the TERM signal works, the kill command will fail. This diff makes it so that we only escalate to a kill if the TERM didn't work.

Test Plan: ran the script, it now succeeds

Reviewers: vihang, michelle, philkuz

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8459

GitOrigin-RevId: 7106408c5d71ca20c801b1e62a2f1351e7852ec0

Summary: cleanup callback code to be a bit more readable.

Test Plan: just reorg to be easier to read

Reviewers: michelle, nlanam

Reviewed By: nlanam

Differential Revision: https://phab.corp.pixielabs.ai/D8451

GitOrigin-RevId: c4c3fd1f96ab3ac55e3843ca3014521e45d78942

Summary: This helps avoid iterating through all trackers. The next diff will present an optimization where we reduce the number of iterations through the more expensive map.

Test Plan: Existing tests.

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Subscribers: yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8430

GitOrigin-RevId: 5d8f7a673d3951a09a16f20333b563d086b02436

Summary: Turns out sourcegraph's fork has some required patches, so we have to wait until they fix their package to reenable TS LSIF uploads.

Test Plan: N/A

Reviewers: vihang

Reviewed By: vihang

Differential Revision: https://phab.corp.pixielabs.ai/D8454

GitOrigin-RevId: 17721d04c05238404cb7d06ff96dacfaced92ee9

Summary:
our auth flow for unregistered users is broken, since we default to manual token auth if the initial CLI auth fails.
instead, we should show the error if the initial CLI auth is an actual authentication error, such as if the user doesnt exist.
this required passing some specific error codes through the whole flow so we can distinguish between errors.

Test Plan: deployed to staging, ran `px auth login` with an unregistered user.

Reviewers: vihang, philkuz

Reviewed By: vihang

JIRA Issues: PC-866

Differential Revision: https://phab.corp.pixielabs.ai/D8453

GitOrigin-RevId: f67a06314f84e9f0b3a517d18cf63d775c407432

Summary: Adds missing libuuid dependency needed for the ANTLR runtime. Things built locally without it b/c I had it installed locally, so I didn't notice until it ran on Jenkins.

Test Plan: N/A

Reviewers: michelle, vihang

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8450

GitOrigin-RevId: 153ef54475d342bf60ec6b7d5f55a8093ec6fcae

Summary:
Move clearing of the perf buffers to StartDataTransferThread().

While not observed in practice, the old version could have been a source of some flakiness
in cases where SetUp() and StartDataTransferThread() were separated by enough time.

Test Plan: Existing tests

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8448

GitOrigin-RevId: f0c22fa6c0762ec500368177d5b0894507ea817d

Summary:
In D8416 I added a `private` flag to bundle creation. I realized that
we shouldn't need the extra flag and can implicily infer script renaming, so
this removes the flag.

Test Plan: Rebuilt the bundle.

Reviewers: zasgar, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8445

GitOrigin-RevId: f3237d5848ed998df9a05a2464c3fa9e7798ae86

Summary: Cleanup based on the new model.

Test Plan: Jenkins

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8444

GitOrigin-RevId: f3a9c3ff4c48e5baf67a6e343a7284792d289c37

Summary: Greatly simplify ConnTrackersManager.

Test Plan: Existing tests

Reviewers: #stirling, yzhao

Reviewed By: #stirling, yzhao

Subscribers: yzhao

Differential Revision: https://phab.corp.pixielabs.ai/D8429

GitOrigin-RevId: 6ff7f47f13cb672e7d7db406568963ecf4cfcb4a

Test Plan: Jenkins

Reviewers: #stirling, oazizi

Reviewed By: #stirling, oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D8413

GitOrigin-RevId: 16757b2c33f5c8cd6ff1893f482b23445f3a503c

Summary: It now lives in the pixie-labs/grafana-plugin repo, so we will remove it from our repo.

Test Plan: n/a

Reviewers: vihang, vjain, zasgar, michelle, #third_party_approvers

Reviewed By: vihang, zasgar, #third_party_approvers

Differential Revision: https://phab.corp.pixielabs.ai/D8442

GitOrigin-RevId: 926eb92a1b8611fd682a22d56e9dcb87ccfc1444

Summary: TSIA

Test Plan: N/A

Reviewers: michelle, vihang

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8443

GitOrigin-RevId: a4b0793847056d8cc31431793db8f54ac10c55c0

Summary: This adds the -a option which allows the fix to be automaticall fixed.

Test Plan: tested on files manually

Reviewers: vihang, michelle

Reviewed By: michelle

Differential Revision: https://phab.corp.pixielabs.ai/D8441

GitOrigin-RevId: 1dcd71451f7189205899b48e2f849b005659577f

Summary: Not complete yet. These are the ones I am familiar with.

Test Plan: Jenkins

Reviewers: #stirling, oazizi

Reviewed By: #stirling, oazizi

Subscribers: oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D8435

GitOrigin-RevId: ce0a78d1164dd1af884d84a1f0abd0ba6e6a72c6

Test Plan: Jenkins

Reviewers: #stirling, oazizi

Reviewed By: #stirling, oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D8440

GitOrigin-RevId: a82781927f20e39b57649cbdf9dede5a048040bb

Summary:
Adds third party dependencies needed for mysql and pgsql parsing including the antlr4 runtime cpp library. And the ANTLR grammar files for MYSQL/PostgreSQL.
There are non-trivial patches to the grammar files, needed to a) get them to work with c++ and avoid certain macro terms such as LOG/BENCHMARK etc, and b) optimize them slightly to avoid some ambiguites that were significantly increasing parsing times.

Test Plan:
All targets build successfully (won't work on jenkins until the chef diff lands with docker changes).
Functionality of the grammars is tested in a later diff.

Reviewers: #third_party_approvers, vihang

Reviewed By: #third_party_approvers, vihang

Subscribers: vihang

JIRA Issues: PP-2687

Differential Revision: https://phab.corp.pixielabs.ai/D8425

GitOrigin-RevId: 1bf53a89387eb4e79de9478f42c8279509327507

Summary:
This restructures how we create script bundles and what data we store
in it. The rest of the changes are to read and write this slighlty new bundle
format.

Test Plan:
Ran dev cloud. Created new script bundles. Tested dev UI and dev cli
against dev scripts and dev cloud.

Reviewers: zasgar, michelle

Reviewed By: zasgar

Subscribers: nlanam

JIRA Issues: PP-2648

Differential Revision: https://phab.corp.pixielabs.ai/D8416

GitOrigin-RevId: 2878fc7f65806436ee3881560cf69d1fada262f8

Summary:
now that we allow vizier to run in any namespace, we should update the CLI delete/collectLogs command to detect the vizier namespace rather than relying on the user to pass it in as a flag.
it does this by searching for any pods with the vizier label. in the future when we have our CRD, this will be a little cleaner since we can just look for the CRD than some random pod.

Test Plan: deployed vizier to a non-pl namespace, ran both CLI delete and collectLogs.

Reviewers: vihang, zasgar, nserrino

Reviewed By: vihang

Differential Revision: https://phab.corp.pixielabs.ai/D8436

GitOrigin-RevId: f0e08d6773dafdaa77086eb993fca6e323fc68d9

Summary:
We want viziers to be deployable to any namespace. this diff templatizes the vizier YAMLS so that the namespace is configurable.
For most of our template values, we use `.Values.templateField`. For namespace, we use `.Release.Namespace` so that it works with Helm chart's `--namespace` flag.
As a result, this will break existing CLIs, because the new `.Release` field will confuse the templater. However, we should prefer to follow standard conventions.

Test Plan:
tested that it works in all of the following cases:
1. updating 0.7.1 -> rc (default, old pl namespace)
2. updating rc -> rc (both pl namespace and new namespace)
3. extract yaml (new namespace)
4. helm chart (new namespace)
exciting screenshot:
{F154569}

Reviewers: vihang, zasgar, nserrino

Reviewed By: vihang

JIRA Issues: PP-2684

Differential Revision: https://phab.corp.pixielabs.ai/D8433

GitOrigin-RevId: 6f46c975739f69506185fa8fa204aef9103c77f7