This project is mirrored from https://gitee.com/mirrors/Mizu.git. Pull mirroring failed .
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer.
  1. 31 Oct, 2021 2 commits
  2. 28 Oct, 2021 1 commit
  3. 20 Oct, 2021 1 commit
    • David Levanon's avatar
      passive-tapper refactor - first phase · 2944493e
      David Levanon authored
      
      * add passive-tapper main tester (#353)
      
      * add passive-tapper main tester
      
      * add errors to go.sum of mizu agent
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * rename main to tester
      
      * build extenssions as part of the tester launch
      
      * add a README to the tester
      
      * solving go.mod and .sum conflicts with addition of go-errors
      
      * trivial warning fixes (#354)
      
      * add passive-tapper main tester
      
      * trivial warning fixes
      
      * add errors to go.sum of mizu agent
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * tcp streams map (#355)
      
      * add passive-tapper main tester
      
      * trivial warning fixes
      
      * add errors to go.sum of mizu agent
      
      * tcp streams map
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * set tcp streams map for tcp stream factory
      
      * change rlog to mizu logger
      
      * errors map (#356)
      
      * add passive-tapper main tester
      
      * trivial warning fixes
      
      * add errors to go.sum of mizu agent
      
      * tcp streams map
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * set tcp streams map for tcp stream factory
      
      * errors map
      
      * change int to uint - errorsmap
      
      * change from int to uint
      
      * Change errorsMap.nErrors to uint.
      
      * change errors map to mizu logger instead of rlog
      
      * init mizu logger in tester + fix errormap declaration
      Co-authored-by: default avatarNimrod Gilboa Markevich <nimrod@up9.com>
      
      * move own ips to tcp stream factory (#358)
      
      * add passive-tapper main tester
      
      * trivial warning fixes
      
      * add errors to go.sum of mizu agent
      
      * tcp streams map
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * set tcp streams map for tcp stream factory
      
      * errors map
      
      * move own ips to tcp stream factory
      
      * Feature/tapper refactor i/move own ips to tcp stream factory (#379)
      
      * add passive-tapper main tester
      
      * trivial warning fixes
      
      * add errors to go.sum of mizu agent
      
      * tcp streams map
      
      * disable host mode for tester - to avoid filterAuthorities
      
      * set tcp streams map for tcp stream factory
      
      * errors map
      
      * move own ips to tcp stream factory
      
      * fix ownips compilation issue
      Co-authored-by: default avatarNimrod Gilboa Markevich <nimrod@up9.com>
      2944493e
  4. 19 Oct, 2021 3 commits
    • M. Mert Yıldıran's avatar
      Remove `github.com/romana/rlog` dependency completely (#374) · 29ba963c
      M. Mert Yıldıran authored
      * Remove `github.com/romana/rlog` dependency completely
      
      * Comment out all the unnecessary logging in the protocol extensions
      
      * Remove commented out all the unnecessary logging lines
      
      * Remove two more lines related to logging
      29ba963c
    • M. Mert Yıldıran's avatar
      Add OAS contract monitoring support (#325) · 145e7cda
      M. Mert Yıldıran authored
      * Add OAS contract monitoring support
      
      * Pass the contract failure reason to UI
      
      * Fix the issues related to contract validation
      
      * Fix rest of the issues in the UI
      
      * Add documentation related to contract monitoring feature
      
      * Fix a typo in the docs
      
      * Unmarshal to `HTTPRequestResponsePair` only if the OAS validation is enabled
      
      * Fix an issue caused by the merge commit
      
      * Slightly change the logic in the `validateOAS` method
      
      Change the `contractText` value to `No Breaches` or `Breach` and make the text `white-space: nowrap`.
      
      * Retrieve and display the failure reason for both request and response
      
      Also display the content of the contract/OAS file in the UI.
      
      * Display the OAS under `CONTRACT` tab with syntax highlighting
      
      Also fix the styling in the entry feed.
      
      * Remove `EnforcePolicyFileDeprecated` constant
      
      * Log the other errors as well
      
      * Get context from caller instead
      
      * Define a type for the contract status and make it...
      145e7cda
    • M. Mert Yıldıran's avatar
      Set the default log level for Agent to `INFO` and raise it to `DEBUG` if... · b7ff0765
      M. Mert Yıldıran authored
      Set the default log level for Agent to `INFO` and raise it to `DEBUG` if `dump-logs=true` is provided (#373)
      
      * Set the default log level for Agent to `INFO` and change it to `DEBUG` if `dump-logs=true` is provided
      
      * Remove `Trace` method and replace its calls with `Debug`
      
      * Export logging levels from `logger` by defining functions
      
      * Revert "Export logging levels from `logger` by defining functions"
      
      This reverts commit e554e40f4a16f07bf7b1f2ee4a7d2544a5a5a19d.
      
      * Run `go mod tidy` on agent
      
      * Define a method named `determineLogLevel`
      b7ff0765
  5. 14 Oct, 2021 1 commit
  6. 13 Oct, 2021 1 commit
  7. 02 Sep, 2021 1 commit
    • M. Mert Yıldıran's avatar
      Refactor Mizu, define an extension API and add new protocols: AMQP, Kafka (#224) · 366c1d0c
      M. Mert Yıldıran authored
      * Separate HTTP related code into `extensions/http` as a Go plugin
      
      * Move `extensions` folder into `tap` folder
      
      * Move HTTP files into `tap/extensions/lib` for now
      
      * Replace `orcaman/concurrent-map` with `sync.Map`
      
      * Remove `grpc_assembler.go`
      
      * Remove `github.com/up9inc/mizu/tap/extensions/http/lib`
      
      * Add a build script to automatically build extensions from a known path and load them
      
      * Start to define the extension API
      
      * Implement the `run()` function for the TCP stream
      
      * Add support of defining multiple ports to the extension API
      
      * Set the extension name inside the extension
      
      * Declare the `Dissect` function in the extension API
      
      * Dissect HTTP request from inside the HTTP extension
      
      * Make the distinction of outbound and inbound ports
      
      * Dissect HTTP response from inside the HTTP extension
      
      * Bring back the HTTP request-response pair matcher
      
      * Return a `*api.RequestResponsePair` from the dissection
      
      * Bring back the gRPC-HTTP/2 parser
      
      * Fix the issues in `handleHTTP1ClientStream` and `handleHTTP1ServerStream`
      
      * Call a function pointer to emit dissected data back to the `tap` package
      
      * roee changes -
      trying to fix agent to work with the "api" object) - ***still not working***
      
      * small mistake in the conflicts
      
      * Fix the issues that are introduced by the merge conflict
      
      * Add `Emitter` interface to the API and send `OutputChannelItem`(s) to `OutputChannel`
      
      * Fix the `HTTP1` handlers
      
      * Set `ConnectionInfo` in HTTP handlers
      
      * Fix the `Dockerfile` to build the extensions
      
      * remove some unwanted code
      
      * no message
      
      * Re-enable `getStreamProps` function
      
      * Migrate back from `gopacket/tcpassembly` to `gopacket/reassembly`
      
      * Introduce `HTTPPayload` struct and `HTTPPayloader` interface to `MarshalJSON()` all the data structures that are returned by the HTTP protocol
      
      * Read `socketHarOutChannel` instead of `filteredHarChannel`
      
      * Connect `OutputChannelItem` to the last WebSocket means that finally the web UI started to work again
      
      * Add `.env.example` to React app
      
      * Marshal and unmarshal `*http.Request`, `*http.Response` pairs
      
      * Move `loadExtensions` into `main.go` and map extensions into `extensionsMap`
      
      * Add `Summarize()` method to the `Dissector` interface
      
      * Add `Analyze` method to the `Dissector` interface and `MizuEntry` to the extension API
      
      * Add `Protocol` struct and make it effect the UI
      
      * Refactor `BaseEntryDetails` struct and display the source and destination ports in the UI
      
      * Display the protocol name inside the details layout
      
      * Add `Represent` method to the `Dissector` interface and manipulate the UI through this method
      
      * Make the protocol color affect the details layout color and write protocol abbreviation vertically
      
      * Remove everything HTTP related from the `tap` package and make the extension system fully functional
      
      * Fix the TypeScript warnings
      
      * Bring in the files related AMQP into `amqp` directory
      
      * Add `--nodefrag` flag to the tapper and bring in the main AMQP code
      
      * Implement the AMQP `BasicPublish` and fix some issues in the UI when the response payload is missing
      
      * Implement `representBasicPublish` method
      
      * Fix several minor issues
      
      * Implement the AMQP `BasicDeliver`
      
      * Implement the AMQP `QueueDeclare`
      
      * Implement the AMQP `ExchangeDeclare`
      
      * Implement the AMQP `ConnectionStart`
      
      * Implement the AMQP `ConnectionClose`
      
      * Implement the AMQP `QueueBind`
      
      * Implement the AMQP `BasicConsume`
      
      * Fix an issue in `ConnectionStart`
      
      * Fix a linter error
      
      * Bring in the files related Kafka into `kafka` directory
      
      * Fix the build errors in Kafka Go files
      
      * Implement `Dissect` method of Kafka and adapt request-response pair matcher to asynchronous client-server stream
      
      * Do the "Is reversed?" checked inside `getStreamProps` and fix an issue in Kafka `Dissect` method
      
      * Implement `Analyze`, `Summarize` methods of Kafka
      
      * Implement the representations for Kafka `Metadata`, `RequestHeader` and `ResponseHeader`
      
      * Refactor the AMQP and Kafka implementations to create the summary string only inside the `Analyze` method
      
      * Implement the representations for Kafka `ApiVersions`
      
      * Implement the representations for Kafka `Produce`
      
      * Implement the representations for Kafka `Fetch`
      
      * Implement the representations for Kafka `ListOffsets`, `CreateTopics` and `DeleteTopics`
      
      * Fix the encoding of AMQP `BasicPublish` and `BasicDeliver` body
      
      * Remove the unnecessary logging
      
      * Remove more logging
      
      * Introduce `Version` field to `Protocol` struct for dynamically switching the HTTP protocol to HTTP/2
      
      * Fix the issues in analysis and representation of HTTP/2 (gRPC) protocol
      
      * Fix the issues in summary section of details layout for HTTP/2 (gRPC) protocol
      
      * Fix the read errors that freezes the sniffer in HTTP and Kafka
      
      * Fix the issues in HTTP POST data
      
      * Fix one more issue in HTTP POST data
      
      * Fix an infinite loop in Kafka
      
      * Fix another freezing issue in Kafka
      
      * Revert "UI Infra - Support multiple entry types + refactoring (#211)"
      
      This reverts commit f74a52d4.
      
      * Fix more issues that are introduced by the merge
      
      * Fix the status code in the summary section
      
      * adding the cleaner again (why we removed it?).
      add TODO: on the extension loop .
      
      * fix dockerfile (remove deleting .env file) - it is found in dockerignore and fails to build if the file not exists
      
      * fix GetEntrties ("/entries" endpoint) - working with "tapApi.BaseEntryDetail" (moved from shared)
      
      * Fix an issue in the UI summary section
      
      * Refactor the protocol payload structs
      
      * Fix a log message in the passive tapper
      
      * Adapt `APP_PORTS` environment variable to the new extension system and change its format to `APP_PORTS='{"http": ["8001"]}' `
      
      * Revert "fix dockerfile (remove deleting .env file) - it is found in dockerignore and fails to build if the file not exists"
      
      This reverts commit 4f514ae1.
      
      * Bring in the necessary changes from f74a52d4
      
      * Open the API server URL in the web browser as soon as Mizu is ready
      
      * Make the TCP reader consists of a single Go routine (instead of two) and try to dissect in both client and server mode by rewinding
      
      * Swap `TcpID` without overwriting it
      
      * Sort extension by priority
      
      * Try to dissect with looping through all the extensions
      
      * fix getStreamProps function.
      (it should be passed from CLI as it was before).
      
      * Turn TCP reader back into two Goroutines (client and server)
      
      * typo
      
      * Learn `isClient` from the TCP stream
      
      * Set `viewer` style `overflow: "auto"`
      
      * Fix the memory leaks in AMQP and Kafka dissectors
      
      * Revert some of the changes in be7c65eb
      
      * Remove `allExtensionPorts` since it's no longer needed
      
      * Remove `APP_PORTS` since it's no longer needed
      
      * Fix all of the minor issues in the React code
      
      * Check Kafka header size and fail-fast
      
      * Break the dissectors loop upon a successful dissection
      
      * Don't break the dissector loop. Protocols might collide
      
      * Improve the HTTP request-response counter (still not perfect)
      
      * Make the HTTP request-response counter perfect
      
      * Revert "Revert some of the changes in be7c65eb"
      
      This reverts commit 08e7d786.
      
      * Bring back `filterItems` and `isHealthCheckByUserAgent` functions
      
      * Remove some development artifacts
      
      * remove unused and commented lines that are not relevant
      
      * Fix the performance in TCP stream factory. Make it create two `tcpReader`(s) per extension
      
      * Change a log to debug
      
      * Make `*api.CounterPair` a field of `tcpReader`
      
      * Set `isTapTarget` to always `true` again since `filterAuthorities` implementation has problems
      
      * Remove a variable that's only used for logging even though not introduced by this branch
      
      * Bring back the `NumberOfRules` field of `ApplicableRules` struct
      
      * Remove the unused `NewEntry` function
      
      * Move `k8sResolver == nil` check to a more appropriate place
      
      * default healthChecksUserAgentHeaders should be empty array (like the default config value)
      
      * remove spam console.log
      
      * Rules button cause app to crash (access the service via incorrect property)
      
      * Ignore all .env* files in docker build.
      
      * Better caching in dockerfile: only copy go.mod before go mod download.
      
      * Check for errors while loading an extension
      
      * Add a comment about why `Protocol` is not a pointer
      
      * Bring back the call to `deleteOlderThan`
      
      * Remove the `nil` check
      
      * Reduce the maximum allowed AMQP message from 128MB to 1MB
      
      * Fix an error that only occurs when a Kafka broker is initiating
      
      * Revert the change in b2abd7b9
      
      
      
      * Fix the service name resolution in all protocols
      
      * Remove the `anydirection` flag and fix the issue in `filterAuthorities`
      
      * Pass `sync.Map` by reference to `deleteOlderThan` method
      
      * Fix the packet capture issue in standalone mode that's introduced by the removal of `anydirection`
      
      * Temporarily resolve the memory exhaustion in AMQP
      
      * Fix a nil pointer dereference error
      
      * Fix the CLI build error
      
      * Fix a memory leak that's identified by `pprof`
      Co-authored-by: default avatarRoee Gadot <roee.gadot@up9.com>
      Co-authored-by: default avatarNimrod Gilboa Markevich <nimrod@up9.com>
      366c1d0c
  8. 09 Aug, 2021 1 commit
  9. 04 Aug, 2021 1 commit
    • Selton Fiuza's avatar
      Feature/tra 3349 validation rules merged with develop (#148) · dea223bf
      Selton Fiuza authored
      * Implemented validation rules, based on: https://up9.atlassian.net/browse/TRA-3349
      
      
      
      * Color on Entry based on rules
      
      * Background red/green based on rules
      
      * Change flag --validation-rules to --test-rules
      
      * rules tab UI updated
      
      * rules tab font and background-color is changed for objects
      
      * Merged with develop
      
      * Fixed compilation issues.
      
      * Renamed fullEntry -> harEntry where appropriate.
      
      * Change green/red logic
      
      * Update models.go
      
      * Fix latency bug and alignment
      
      * Merge Conflicts fix
      
      * Working after merge
      
      * Working on Nimrod comments
      
      * Resolving conflicts
      
      * Resolving conflicts
      
      * Resolving conflicts
      
      * Nimrod Comments pt.3
      
      * Log Error on configmap creation if the user doesn't have permission.
      
      * Checking configmap permission to ignore --test-rules
      
      * Revert time for mizu to get ready
      
      * Nimrod comments pt 4 && merge develop pt3
      
      * Nimrod comments pt 4 && merge develop pt3
      
      * Const rulePolicyPath and filename
      Co-authored-by: default avatarNeim <elezin9@gmail.com>
      Co-authored-by: default avatarnimrod-up9 <nimrod@up9.com>
      dea223bf
  10. 01 Aug, 2021 1 commit
  11. 25 Jul, 2021 1 commit
  12. 22 Jul, 2021 1 commit
  13. 21 Jul, 2021 2 commits
  14. 19 Jul, 2021 1 commit
  15. 13 Jul, 2021 1 commit
  16. 12 Jul, 2021 2 commits
  17. 29 Jun, 2021 1 commit
  18. 31 May, 2021 1 commit
    • RamiBerm's avatar
      WIP · 47237f05
      RamiBerm authored
      47237f05
  19. 24 May, 2021 2 commits
  20. 20 May, 2021 1 commit
    • nimrod-up9's avatar
      Tap multiple pods statically (#51) · da24608b
      nimrod-up9 authored
      
      * WIP
      
      * Update tap.go, provider.go, and 2 more files...
      
      * WIP
      
      * WIP
      
      * Solved routine hanging forever: Added missing flag when calling mizuagent.
      
      * Iterate channel with range.
      
      * Panic if har channel is nil or if websocket connection is nil.
      
      * StartPassiveTapper returns read only channel.
      
      * Solved program exiting immediately: Wait for interrupt signal instead of exiting.
      
      * Solve connecting issue - Retry a few times.
      
      * Use lib const instead of magic.
      
      * Nicer error prints.
      
      * Don't coninue piping message if there is an error.
      
      * Comment.
      
      * Dependency injection.
      
      * no message
      
      * Fixed comment.
      
      * Print tapped addresses when they are updated.
      
      * Print errors in cleanup if there are any.
      Co-authored-by: default avatarRamiBerm <rami.berman@up9.com>
      Co-authored-by: default avatarRoee Gadot <roee.gadot@up9.com>
      da24608b
  21. 10 May, 2021 2 commits
  22. 09 May, 2021 1 commit
  23. 06 May, 2021 1 commit
  24. 02 May, 2021 1 commit
  25. 28 Apr, 2021 2 commits
  26. 25 Apr, 2021 2 commits
  27. 22 Apr, 2021 1 commit