This project is mirrored from https://gitee.com/cowcomic/pixie.git. Pull mirroring failed .
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer.
  1. 19 Feb, 2019 1 commit
  2. 15 Feb, 2019 1 commit
  3. 19 Feb, 2019 2 commits
    • Phillip Kuznetsov's avatar
      PL-354 Mem Source Node should only contain strings. · d369f1a4
      Phillip Kuznetsov authored
      Summary: test in verifier that makes sure mem source node only contains trings
      
      Test Plan: n/a
      
      Reviewers: zasgar, michelle, oazizi, kgandhi, #engineering
      
      Reviewed By: michelle, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D312
      
      GitOrigin-RevId: bb9efe21d1e51a9ab00955b8d9a5c4d47c121aeb
      d369f1a4
    • Kaushal Gandhi's avatar
      PL-341: Adding availability function to determine whether Stirling can use a SourceConnector · f5520d4b
      Kaushal Gandhi authored
      Summary:
      For the registry, we use a virtual function in the Source Connectors to
      determine whether a system can support that Source Connector. Based on whether
      it is available, Stirling can add it as a source from which to gather data. For
      any other data source dependencies, we plan to add a config_setting to exclude
      headers and the appropriate code to be included in the binary.
      
      Test Plan:
      Manually tested fake proc stat data with the Stirling wrapper to
      ensure that the source was available
      
      Reviewers: oazizi, zasgar, #engineering
      
      Reviewed By: oazizi, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D308
      
      GitOrigin-RevId: b2a3f50a6643ac1bafb5bf9df55d50ef309651fe
      f5520d4b
  4. 16 Feb, 2019 1 commit
    • Phillip Kuznetsov's avatar
      PL-335: Make ast macro · e0b1c2d6
      Phillip Kuznetsov authored
      Summary: make a macro that maps AstType enum to string.
      
      Test Plan: Run it, see the magic of strings and not enum values.
      
      Reviewers: zasgar, michelle, oazizi, #engineering
      
      Reviewed By: zasgar, oazizi, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D305
      
      GitOrigin-RevId: 07858f9ebf39eb3fcdc36b20ce86a20643fbd456
      e0b1c2d6
  5. 19 Feb, 2019 2 commits
    • Michelle Nguyen's avatar
      PL-353 Add Compiler test · 5a5ddba5
      Michelle Nguyen authored
      Summary: add a compiler test that creates the compiler with a simple compiler state. we will flesh out the test more as we get more parts of the compiler in
      
      Test Plan: this is a test
      
      Reviewers: #engineering, philkuz, zasgar
      
      Reviewed By: #engineering, philkuz, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D295
      
      GitOrigin-RevId: 92febcd9717381a89b061e00136380c1cf48034c
      5a5ddba5
    • Michelle Nguyen's avatar
      PL-256 Add tableName -> RowDescriptor map to CompilerState · a8c1240c
      Michelle Nguyen authored
      Summary: we need a way to look up each table's schema in the compiler. add a map in the compiler state with that information.
      
      Test Plan: unit test for table_store
      
      Reviewers: #engineering, zasgar, philkuz
      
      Reviewed By: #engineering, zasgar, philkuz
      
      Subscribers: oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D290
      
      GitOrigin-RevId: 33f8e4da415fdc9549e93710414c73c7e18b839c
      a8c1240c
  6. 18 Feb, 2019 1 commit
    • Michelle Nguyen's avatar
      PL-327 Carnot Class: Wrapper for Compiler & Execution Engine · d1c8e171
      Michelle Nguyen authored
      Summary:
      Added the Carnot class, which brings the compiler and execution engine together. The class keeps track of necessary state. When a query is made, it get the logical plan from the compiler, and then executes the logical plan.
      
      Also fixed some bugs in the planGraph class.
      
      Test Plan: added unit test for planWalker. we should write component tests once the compiler is ready.
      
      Reviewers: #engineering, zasgar, philkuz, kgandhi
      
      Reviewed By: #engineering, zasgar, philkuz, kgandhi
      
      Subscribers: kgandhi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D287
      
      GitOrigin-RevId: 8a5f5a3bb0be7ea6712b6833b6e4d26ad22ea4ca
      d1c8e171
  7. 16 Feb, 2019 2 commits
    • Omid Azizi's avatar
      Stirling is born · ce19cc96
      Omid Azizi authored
      Summary: Finally migrating to the Stirling name
      
      Test Plan: none
      
      Reviewers: #engineering, kgandhi, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Subscribers: zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D306
      
      GitOrigin-RevId: a582526b33920f11cfbe101bb12eb77f911ea2fd
      ce19cc96
    • Omid Azizi's avatar
      Bazel build of bpftrace · 5ed31338
      Omid Azizi authored
      Summary: Add a submodule for bpftrace, and modify the build system to build it.
      
      Test Plan: Count on phabricator to catch any build issues!
      
      Reviewers: #engineering, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D292
      
      GitOrigin-RevId: 6fce53a1c509dd9511f03de60b727b94d59a5440
      5ed31338
  8. 15 Feb, 2019 13 commits
    • Omid Azizi's avatar
      Reduce duration of data_table_test · 14b527e0
      Omid Azizi authored
      Summary: Test was simply too good to handle, so reducing number of iterations
      
      Test Plan: None
      
      Reviewers: #engineering, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D302
      
      GitOrigin-RevId: 157de338777019a570d2ae7f5405aa4ba0389f26
      14b527e0
    • Michelle Nguyen's avatar
      PL-184 IRGraphWalker class · 5bd97f00
      Michelle Nguyen authored
      Summary:
      add an IRWalker class which walks through the IR nodes in an IR operator graph. This class is heavily based on what we already have for the PlanFragmentWalker and ScalarExpressionWalker.
      We'll use this walker in the compiler, which will use it to walk through all of the nodes and convert those nodes to their protobufs.
      
      Test Plan: added unit test
      
      Reviewers: philkuz, zasgar, #engineering
      
      Reviewed By: zasgar, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D301
      
      GitOrigin-RevId: 8f22bce8278b7b44bdf767f1d7f06d7acb6fdfd3
      5bd97f00
    • Zain Asgar's avatar
      Update clang libraries in build docker image · e58da268
      Zain Asgar authored
      Summary: Updates related to D291
      
      Test Plan: Jenkins
      
      Reviewers: #engineering, oazizi
      
      Reviewed By: #engineering, oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D297
      
      GitOrigin-RevId: 6a6edf1a5423b2ebafdde553f0ad58bb4fd59f1b
      e58da268
    • Phillip Kuznetsov's avatar
      Moving parent from individual ops to the parent op class · ac479c9c
      Phillip Kuznetsov authored
      Summary: making parent an individual thing
      
      Test Plan: n/a
      
      Reviewers: michelle, #engineering
      
      Reviewed By: michelle, #engineering
      
      Subscribers: oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D296
      
      GitOrigin-RevId: cbc153452f91bb62c83c8c561963d2b45c5587ce
      ac479c9c
    • Kaushal Gandhi's avatar
      PL-241: Making the source registry part of the data collector · 4b0b7ff7
      Kaushal Gandhi authored
      Summary:
      Modified the constructor for data collector to take a registry. Updated data
      collector wrapper to use a fake registry for testing. Some clean up and
      initialization as well.
      
      Test Plan:
      Locally tested data collector wrapper with the fake proc stat source
      to produce some data in the table:
      
      fake_proc_stat_source
      .time: 691340523036074
      system_percentage: 70
      .time: 691341525530045
      system_percentage: 70
      .time: 691342528109594
      system_percentage: 70
      .time: 691343530692138
      system_percentage: 70
      
      Reviewers: oazizi, #engineering
      
      Reviewed By: oazizi, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D299
      
      GitOrigin-RevId: 9eb940ea885b784952dad9d34872228f013857bc
      4b0b7ff7
    • Michelle Nguyen's avatar
      Fix RegistryInfo · 176ad206
      Michelle Nguyen authored
      Summary: Given the udf/uda name and args, it should return the return type.
      
      Test Plan: updated unittest
      
      Reviewers: philkuz, #engineering
      
      Reviewed By: philkuz, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D300
      
      GitOrigin-RevId: 9354c720c4b1cfe0547717bb7fdd23e101c923d5
      176ad206
    • Kaushal Gandhi's avatar
      PL-241 Change source registry to store function to create source connector · 41a42467
      Kaushal Gandhi authored
      Summary:
      The source registry used to hold the source connector objects. Instead
      it would be better for the registry to hold the function to create a source
      connector and let the data collector create the source connector and own the
      source connector. This way the registry has all the information regarding a
      source and the data collector can create sources as needed. In the future we
      could apply filters in the data collector based on type, etc. to create only
      sources that it needs.
      
      Test Plan: Updated unit test
      
      Reviewers: #engineering, oazizi, zasgar
      
      Reviewed By: #engineering, oazizi, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D288
      
      GitOrigin-RevId: f297da3b7fbe23b6a2c437ec51503e6245e7f120
      41a42467
    • Kaushal Gandhi's avatar
      PL-241: Creating a data source connector class for proc stat · f77f1d53
      Kaushal Gandhi authored
      Summary:
      Add a ProcStatConnector to test out the path from a source connector
      that reads data from a file and is able to populate a data table based on a
      common InfoClassSchema. Note that the source connector itself is temporary for
      M2. But this allows us to test a bunch of stuff.
      
      Test Plan:
      Added a unit test to get data from a source and populate a data
      table.
      
      Reviewers: #engineering, oazizi, zasgar
      
      Reviewed By: #engineering, oazizi, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D279
      
      GitOrigin-RevId: ceddc2e7d01f1a0da22c08604971648c07221f30
      f77f1d53
    • Zain Asgar's avatar
      Fix accidental typo · 43751273
      Zain Asgar authored
      Summary: Not sure how this happened.
      
      Test Plan: Jenkins
      
      Reviewers: michelle, oazizi, #engineering, kgandhi
      
      Reviewed By: #engineering, kgandhi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D298
      
      GitOrigin-RevId: e05e0607dacb9ad58aef0346ab7e31b9729cd55b
      43751273
    • Zain Asgar's avatar
      Add License file · d8830724
      Zain Asgar authored
      Summary: Added license file.
      
      Test Plan: N/A
      
      Reviewers: #engineering, oazizi, ishan, kgandhi
      
      Reviewed By: #engineering, oazizi, ishan, kgandhi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D289
      
      GitOrigin-RevId: 58412e1ec54e48b7b399babd44e6dfbd2bdca461
      d8830724
    • Michelle Nguyen's avatar
      PL-350 Add SinkNodeIR · 023c9925
      Michelle Nguyen authored
      Summary: tsia
      
      Test Plan: updated astvisitor unit test
      
      Reviewers: #engineering, philkuz, zasgar
      
      Reviewed By: #engineering, philkuz
      
      Differential Revision: https://phab.corp.pixielabs.ai/D294
      
      GitOrigin-RevId: 9c29101b55e2a7fc2046f9b88800ea080bb7a1f5
      023c9925
    • Phillip Kuznetsov's avatar
      Adding time data to the memory source IR for ease · 840b1e80
      Phillip Kuznetsov authored
      Summary:
      (it's a quickie)
      Adding time data to the memory source IR for ease
      
      Test Plan: n/a
      
      Reviewers: michelle, #engineering
      
      Reviewed By: michelle, #engineering
      
      Differential Revision: https://phab.corp.pixielabs.ai/D293
      
      GitOrigin-RevId: 1730065674133886f99b5670b58bfc18ac73e2bc
      840b1e80
    • Phillip Kuznetsov's avatar
      PL-257: Verification for IRGraph connections. · 1f6b6277
      Phillip Kuznetsov authored
      Summary:
      Adding verifier test that checks to make sure IR nodes are connected to the write types of nodes.
      
      Also checks to make sure they have line, col information for user query debug info.
      
      Test Plan: ir_verifier_test.cc
      
      Reviewers: #engineering, michelle, zasgar
      
      Reviewed By: #engineering, michelle
      
      Subscribers: oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D285
      
      GitOrigin-RevId: 5a95e4ce57a6fbdea6f58d6124cef750f930f6a2
      1f6b6277
  9. 14 Feb, 2019 3 commits
    • Phillip Kuznetsov's avatar
      Adding Agg node · 8d0ee4cc
      Phillip Kuznetsov authored
      Summary:
      Adding Agg node
      
      Adding Aggregate handling.
      
      Make a prelim working version of agg
      
      fixing diffs
      
      Updating agg node call to work with arbitrary number of arguments.
      
      Raw string to not in ast_visitor_test.
      
      Test Plan: Currently unit test for just compilation. Will add more tests once D269 is complete
      
      Reviewers: #engineering, zasgar, michelle
      
      Reviewed By: #engineering, michelle
      
      Differential Revision: https://phab.corp.pixielabs.ai/D283
      
      GitOrigin-RevId: d7763673d42076065239fe47c8e6e32206f11470
      8d0ee4cc
    • Zain Asgar's avatar
      Add libclang.a to our build · 7d5043c3
      Zain Asgar authored
      Summary: This is needed so we can statically build and rely on clang.
      
      Test Plan: N/A
      
      Reviewers: #engineering, oazizi
      
      Reviewed By: #engineering, oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D291
      
      GitOrigin-RevId: 48e7c310fd063afdf5dade9ed5e4aa493cb0aa87
      7d5043c3
    • Omid Azizi's avatar
      Updated clang for bpftrace · d4d43e52
      Omid Azizi authored
      Summary: Updated scripts for updated clang (required for bpftrace). This version enables RTTI.
      
      Test Plan: None
      
      Reviewers: #engineering, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D286
      
      GitOrigin-RevId: d27762ac96397cc24600134bd2f6e1f0b85a0fd8
      d4d43e52
  10. 13 Feb, 2019 10 commits
    • Zain Asgar's avatar
      PL-295 -- Added Hash utils · a5359ff6
      Zain Asgar authored
      Summary: Used in aggregate node.
      
      Test Plan: Jenkins
      
      Reviewers: oazizi, michelle, #engineering
      
      Reviewed By: oazizi, #engineering
      
      Subscribers: oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D281
      
      GitOrigin-RevId: 0164911d18ded9db3f879509997b4be665e33f8c
      a5359ff6
    • Zain Asgar's avatar
      PL-295 add farmhash · 6a5b3f68
      Zain Asgar authored
      Summary: This is used in the aggregate node.
      
      Test Plan: Added a unit test to make sure the build works.
      
      Reviewers: #engineering, michelle
      
      Reviewed By: #engineering, michelle
      
      Subscribers: oazizi
      
      Differential Revision: https://phab.corp.pixielabs.ai/D280
      
      GitOrigin-RevId: 61c8d1272d867b8026d4d506ec0d62560d60ae3c
      6a5b3f68
    • Omid Azizi's avatar
      Stirling: Support for chunked Record Batches · c547cb1d
      Omid Azizi authored
      Summary: The active record batch can be sealed periodically, before the list of sealed record batches are sent out.
      
      Test Plan: Append a bunch of data, and read it out as a fake agent. Then check that all data is there.
      
      Reviewers: #engineering, kgandhi, zasgar
      
      Reviewed By: #engineering, kgandhi, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D271
      
      GitOrigin-RevId: 90e096d71c27912b40f00360c9e1dbc3b9454fd7
      c547cb1d
    • Michelle Nguyen's avatar
      PL-328 Compiler class · 3b3a63a1
      Michelle Nguyen authored
      Summary: Add the compiler class, which will bring together all of @philkuz's work.
      
      Test Plan: tests will come when more of the compiler is implemented
      
      Reviewers: #engineering, philkuz, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Subscribers: philkuz
      
      Differential Revision: https://phab.corp.pixielabs.ai/D284
      
      GitOrigin-RevId: 496bacddcf048b9c1dd25aaa073b021500e4f794
      3b3a63a1
    • Michelle Nguyen's avatar
      PL-328 Rename old compilerState -> planState, add compilerState · 59f9357c
      Michelle Nguyen authored
      Summary:
      we had an existing class called CompilerState, which contains the udf/uda registry. We don't want to pass this info around for our actual compilerState, so renamed this class to planState.
      Added a new compilerState class which tracks the registry lookup and schema.
      
      Test Plan: existing tests should pass
      
      Reviewers: #engineering, zasgar, philkuz
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D282
      
      GitOrigin-RevId: e13327eb43316e458fc161cf81dc53f4c774b831
      59f9357c
    • Michelle Nguyen's avatar
      PL-267 UDF Registry Wrapper · 6c5bb407
      Michelle Nguyen authored
      Summary: The compiler needs something that it can give a UDF name and arg types, and returns whether or not that is a valid UDF. The registry wrapper takes an exported UDFInfo and creates a map which it uses to check if the UDF exists.
      
      Test Plan: unit test
      
      Reviewers: #engineering, philkuz, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D274
      
      GitOrigin-RevId: de3948aa482686e007660c4827b2e829b98d31e0
      6c5bb407
    • Michelle Nguyen's avatar
      PL-205 Add Execute method for ExecGraph · da798d5c
      Michelle Nguyen authored
      Summary: add function which calls execute on the execGraph
      
      Test Plan: added unit test.
      
      Reviewers: #engineering, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D272
      
      GitOrigin-RevId: aec4cae618bf02adc77e400368075541b6f326a2
      da798d5c
    • Michelle Nguyen's avatar
      PL-296 Add ExecGraph class · 18e534cd
      Michelle Nguyen authored
      Summary: The execGraph takes a planFragment and converts the operators in the plan fragment into ExecNodes.
      
      Test Plan: unit test which checks that the structure of the graph is correct. advice on how to add a test that checks the input/output descriptors would be appreciated.
      
      Reviewers: #engineering, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D267
      
      GitOrigin-RevId: 235da5ecb5646bb509e8023f0317b452d5edf625
      18e534cd
    • Phillip Kuznetsov's avatar
      PL-321 Adding Lambda handling and Map node. Summary: Adding Lambda functionality and Map node. · 8be6b918
      Phillip Kuznetsov authored
      Test Plan: Currently unit test for just compilation. Will add more tests once D269 is complete
      
      Reviewers: #engineering, oazizi, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Subscribers: michelle
      
      Differential Revision: https://phab.corp.pixielabs.ai/D270
      
      GitOrigin-RevId: 6b9ece0b8578be1caa66bc8979b132db81ba5567
      8be6b918
    • Michelle Nguyen's avatar
      PL-327 Add StringReader which extends libpypa's Reader class · e49316e8
      Michelle Nguyen authored
      Summary: We need a StringReader class, because libpypa only supplies a FileBuf, which requires the query to be inside a file.
      
      Test Plan: unit test
      
      Reviewers: #engineering, philkuz, zasgar
      
      Reviewed By: #engineering, zasgar
      
      Differential Revision: https://phab.corp.pixielabs.ai/D278
      
      GitOrigin-RevId: 91e5f6a5d1e610363c82a5d63cbc86ffae717dd2
      e49316e8
  11. 11 Feb, 2019 3 commits
  12. 12 Feb, 2019 1 commit