Commit Graph

55 Commits

Author SHA1 Message Date
Dustin Decker c2426df4d6 Disable sentiment verifier and update teams webhook to avoid being stateful (#646) 2022-07-07 16:55:45 -07:00
Miccah 6fa2171a22 Refactor Engine to wait for workers in a Finish method (#581)
* Refactor Engine to wait for workers in a Finish method

This should allow the engine to run multiple concurrent scans if
desired before shutting down.

Additionally, this commit refactors some of the printing logic to the
output package.

* Fix tests
2022-05-25 11:35:44 -05:00
Dustin Decker 235a60a850 add more detectors (#577) 2022-05-23 18:39:49 -07:00
Dustin Decker 606dadfbb1 Import more detectors (#563) 2022-05-17 18:56:48 -07:00
ahrav d2605354fe [THOG-332 ]Remove TokenSource interface from the init method of Source. (#539)
* Remove TokenSource interface from the init method of Source.

* Remove proto message.

* Remove proto message.

* Fix tests.

* Fix filesystem test.
2022-05-13 14:35:06 -07:00
ahrav b0d79180f6 [THOG-314] Add new parameter to the Init method for the source interface. (#529)
* Add new parameter to the Init method for the source interface.

* Add Oauth Token service.

* remove .test file.

* remove .test file.

* Fix param spelling.

* fix tests with new param in init

* Add missing gock lib.
2022-05-10 11:11:43 -07:00
ahrav e12432cef8 [THOG-315] Replace bytes.buffer with strings.builder. (#533)
* Replace bytes.buffer with string.builder.

* Remove profiling.

* Remove detector changes.

* ignore .test files.

* fix detectors removed.
2022-05-09 17:02:46 -07:00
Bill Rich 6ee5c57968 Fix overlooked nil (#523)
* Fix overlooked nil

* Use default case
2022-05-04 15:45:12 -07:00
Bill Rich c78120e56f Syslog source (#500)
* Add syslog source

* only load cert/key with tls

* Cleanup

* Linting

Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-05-04 15:08:11 -07:00
Bill Rich 62bb3c57d3 Keep first line number for each chunk (#520) 2022-05-04 14:11:10 -07:00
Dustin Decker d217a517c0 Cleanup packages and include more detectors (#521)
* clean up duplicate packages

* include more detectors
2022-05-04 09:27:42 -07:00
Dustin Decker 913c75db15 Add 12 more detecotrs 2022-04-21 15:31:17 -07:00
Dustin Decker 9622932d81 Add 12 detectors (#432) 2022-04-19 12:32:00 -07:00
Dustin Decker 972108aea4 21 new detectors (#347) 2022-04-08 16:07:39 -07:00
Dustin Decker 8d2dd624e4 fetcher controls fetch interval, prevent fetching loop 2022-04-03 21:13:39 -07:00
Dustin Decker a1dfcde9a6 address detector issues (#123) 2022-04-01 18:51:41 -07:00
Miccah 78b344d7b8 Add --include-members flag to scan all members of an organization (#118)
* Add --member-repos flag to scan all members of an organization

* Move flag to the githubScan sub-command

Co-authored-by: Miccah Castorina <miccah.castorina@trufflesec.com>
2022-04-01 18:22:37 -07:00
ahrav cedb3393d1 [THOG-128] Code cleanup/ OSS onboarding (#117)
* Small amount of code clean up.

* Rename sem to concurrency for better readability and to remove an extra comment.

* fix stashing issue.

Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2022-04-01 16:47:27 -07:00
Bill Rich c2b4f0bc39 Include line numbers in git metadata (#97)
* Include line numbers in git metadata

* Update tests for fragments and line numbers
2022-03-22 09:27:15 -07:00
Bill Rich 0ea3b93238 Use git cmd for clone (#96)
* Use git command to clone

* Check for git command when cloning
2022-03-22 09:26:58 -07:00
trufflesteeeve d33551e7dc Add midise detector (#88) 2022-03-17 13:38:05 -07:00
Bill Rich e8234c3514 Remove unused code and add git binary check (#80) 2022-03-14 17:47:18 -07:00
Dustin Decker 72c13c4b8f Update detector process and readme (#79) 2022-03-14 17:27:14 -07:00
Bill Rich 0ee34a5be6 Use gitleaks git cmd stream (#75)
* Switch to git cmd stream

* Fix rebase issues
2022-03-14 17:12:58 -07:00
Bill Rich 6486c18565 Add s3 support to CLI (#76)
* Add s3 support to CLI

* Clean up comments

Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2022-03-14 17:07:07 -07:00
Bill Rich 2cb5b27d3b Add GitLab support to CLI (#78)
* Add GitLab support to CLI

* Update cli message

Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2022-03-14 17:05:15 -07:00
Bill Rich 8d1db04c36 Add filesystem scan to CLI (#77)
* Add filesystem scan to CLI

* Fix linter errors

* Update message

Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2022-03-14 17:04:19 -07:00
Dustin Decker 43de9c3604 Update defaults 2022-03-11 17:25:31 -08:00
Dustin Decker b4ac103d11 Add snifftest 2022-03-11 10:24:36 -08:00
Dustin Decker b0e0c26137 update detectors 2022-03-11 10:24:36 -08:00
Bill Rich 55b839fc5a Only scan files that changed from base to head (#68)
* Only scan files that changed from base to head

* Acknowledge ignored errors
2022-03-08 08:48:00 -08:00
Bill Rich bdbc7e80d1 Use sync.Map to avoid concurrent map writes (#66) 2022-03-05 22:42:06 -08:00
Bill Rich 665b0bf928 Add timestamp (#61)
* Add timestamp to sources

* Include timestamp in sources
2022-03-04 08:39:23 -08:00
Bill Rich 9f378b8cb3 Resolve a ref as arg for --since_commit (#57) 2022-03-04 08:39:23 -08:00
Dustin Decker 6f32b108a3 Disable GetEmails 2022-03-04 08:39:22 -08:00
Bill Rich c144630c54 Add parent results to ignore list (#47)
* Add parent results to ignore list

* Force concurrency to 1 when base commit is set
2022-03-04 08:39:22 -08:00
Dustin Decker 1da3e0f723 turn off getemail scanner 2022-03-04 08:39:22 -08:00
Bill Rich 30034f5d28 Use metadata specific to source type (#48) 2022-03-04 08:39:22 -08:00
Bill Rich 56dc1b109c Check commit order, dedupe results, and support using a head commit. (#44)
* Check commit order and support using a head commit.

* Only apply dedupe to git bases source
2022-03-04 08:39:22 -08:00
Dustin Decker c20e9f4732 improvements 2022-03-04 08:39:17 -08:00
Dustin Decker 77418fb3f8 module v3 2022-02-15 18:54:47 -08:00
Dustin Decker 79496b8142 Add context timeout to scanners 2022-02-15 18:54:47 -08:00
Dustin Decker ee99f0c9a2 Record avg detector time 2022-02-15 18:54:47 -08:00
Dustin Decker 152ef6d4e1 add include forks option (#37) 2022-02-15 18:54:47 -08:00
Dustin Decker a96de1a2cd update docs and support multi platform docker images 2022-02-15 18:54:47 -08:00
Dustin Decker e15fa3a5be helpful logging 2022-02-15 18:54:47 -08:00
Bill Rich 206b99704b Change log order and path filtering. 2022-02-15 18:54:47 -08:00
Bill Rich 28ed0c3b7c Complete support for existing git scan flags (#13)
* Add `since_commit` to git scan

* Support `max_depth` option for git scan

* Use new options in github and gitlab sources

* Address review feedback

Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Dustin Decker 089b5c9063 improved plain output 2022-02-15 18:54:47 -08:00
Dustin Decker 03ead2f7ed Integrate GitHub source 2022-02-15 18:54:47 -08:00