f5b28d45c3
cleanup nesting
2023-09-26 10:50:43 -04:00
0c40c0e8a0
update package name and add to defaults
2023-09-26 10:22:29 -04:00
4af40cbeb0
updating gitlabV1 detector to only work w/ v1 secrets, and v2 detector only w/ v2 secrets
2023-09-26 10:09:50 -04:00
6d644704b3
Delete temp.txt
...
delete test file (note: these are not real secrets)
2023-09-14 16:55:29 -04:00
cb6d26cf68
remove gitlabV2 references
2023-09-14 15:09:36 -04:00
f402b4d594
consolidating both versions of the gitlab detector
2023-09-14 14:59:30 -04:00
fd840b72cb
updating secret to s1 to match convention
2023-09-11 16:07:19 -04:00
953e7f43bd
update gitlabv2 to tri-state
2023-09-11 14:36:48 -04:00
3f84a6700e
add tri state verification to slack (not slack webhook) ( #1731 )
...
* add client, add known false positive check
* fix idiosyncracies
* cleanup
* cleanup comment
* add unexpected error test case
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com >
2023-09-11 08:38:43 -07:00
fdeccf06a0
cache dupes w/ different decoders ( #1754 )
...
* only cache dupes that have different decoders.
* add test.
* remove file.
* update comment.
2023-09-11 08:18:48 -07:00
70cdff915b
add test for custom providers. ( #1759 )
2023-09-11 08:18:34 -07:00
2c32b14df1
always close aws response body ( #1758 )
2023-09-11 10:42:14 -04:00
e53a72abd2
[chore] - Sentry detector update ( #1746 )
...
* add test case for account deactivated.
* Handle empty case.
2023-09-11 07:26:09 -07:00
62ce9bac8b
Retry AWS verification 403s ( #1757 )
...
This PR introduces retries on 403s in the AWS detector in attempt to work around erroneous SignatureDoesNotMatch errors. As part of the work, the detector has been refactored somewhat, resulting in two minor semantic changes:
Errors crafting the verification HTTP request no longer result in the candidate secret being discarded.
The known-words-based false positive check now runs (and potentially discards candidate secrets) even if verification is disabled. This unifies its behavior with the hash-based false positive check.
2023-09-08 15:32:53 -04:00
e68ace5338
Always attempt to return a git link ( #1756 )
2023-09-08 15:17:29 -04:00
3aa5369608
Add Tailscale detector ( #1719 )
...
* Add tailscale detector
* PR feedback: match on first element
2023-09-07 19:11:17 -07:00
8d66fde6de
updating sendgrid detector to use tri-state verification ( #1735 )
...
* updating sendgrid detector to use tri-state verification
2023-09-07 14:21:03 -04:00
2a9f34962d
Add optional param to Chunks ( #1747 )
...
* Add interface for targeted chunking.
* use optional args.
* update Chunks method signature.
* update tests.
* fix test.
* update QueryCriteria type.
2023-09-07 09:03:37 -07:00
f6512ac4ca
Use common chunker for archive handler ( #1717 )
...
* optimize the ReadToMax.
* add comment.
* remove dumb comment.
* update comment.
* fix test.
* lint.
* Expired invite link fix (#1713 )
* Use comon chunker for archive handler.
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com >
2023-09-06 09:26:33 -07:00
bf581ae9f9
Fix pagerdutyapikey Detector ( #1749 )
...
* Fix pagerdutyapikey detector by broadening regex
* Add 'pd' to list of pagerdutyapikey keywords
2023-09-06 09:15:39 -07:00
d3e7c5acc2
updating jiratoken and jiratokenV2 to use tri-state verification + updating tests ( #1744 )
2023-09-05 16:32:05 -04:00
abb131e502
[chore] - update Docker source ( #1708 )
...
* Add concurrency and common chunker.
* lint.
* address comments.
2023-09-05 07:40:38 -07:00
b28a2b9177
updating sendbird detector to use tri-state verification ( #1737 )
...
* updating sendbird detector to use tri-state verification
2023-09-05 10:39:05 -04:00
afe708519b
Validate S3 source ( #1715 )
...
This PR adds S3 source validation. This is accomplished by factoring out common "bucket visiting" logic to be used by both scanning and validation.
2023-09-05 10:18:58 -04:00
c9e6086644
Correctly create azure git links. ( #1743 )
2023-09-01 10:38:51 -07:00
000065b225
[chore] - fix sentry detector ( #1738 )
...
* fix sentry detector to check response.
* use err.
* address comments.
2023-09-01 10:33:21 -07:00
0a949d7131
iterating on suggestions ( #1742 )
2023-09-01 10:20:18 -07:00
2e4b17d3f4
update jira detector to match new variable tokens ( #1720 )
...
* update jira detector to match new variable tokens
* add versioned interface
* use _v2 format for naming packages w. versioner
- also added documentation for internal/external contrib.
* migrate jira and jira_v2 secrets tests to newer version
* add v2 specific domain and email
* add support for tri-state verification
---------
Co-authored-by: Zubair Khan <zkhan124@umd.edu >
2023-09-01 12:14:36 -04:00
78bbb89a30
add tri-state verification for twilio detector ( #1729 )
...
* add tri state for twilio
* save progress
* fix twilio tristate test
* resolve lint issue
2023-08-31 12:06:18 -04:00
6695cf1dce
added sourcegraph token verification detection ( #1730 )
2023-08-31 08:47:13 -07:00
4aa91337e5
Update to Go 1.21 ( #1733 )
...
* Update to Go 1.21
* go mod tidy
2023-08-31 08:46:43 -07:00
07702ea06d
update slack webhook with tri-state verification ( #1724 )
...
* add tristate basics
* update test
* cleanup
* fix leading space
* fix accidental comment
* save changes
* update secret in gsm, fix bug
* fix linter issue
* cleanup
* use defaultClient
2023-08-30 18:18:17 -04:00
a2c0abbfd6
Unify S3 client creation logic ( #1657 )
...
This PR unifies some code paths within the S3 source. This is being done to better support a future implementation of S3 source validation; less code that runs means less code to validate. The logical change is to move the handling of "role-less" operation down the call tree, which allows for a single code path for more of the S3 code.
This PR also fixes a bug that would occur in the (rare) case that the source couldn't create a regional S3 client. Before, an error would be logged, but it would be followed by a panic. Now the bucket in question is skipped.
2023-08-30 17:49:37 -04:00
522b2fab29
Add a cancel cause to job cancellation ( #1728 )
2023-08-30 12:00:44 -07:00
c77c1172c8
Add the 'Cause' family of functions to the context wrapper library ( #1725 )
...
Go 1.20 introduced `WithCancelCause`, `WithTimeoutCause`, and
`WithDeadlineCause` to allow adding a reason to context cancellations.
Adding it to our wrapper will allow us to use these features.
2023-08-30 07:57:45 -07:00
d6afca682b
remove fmt.Print ( #1727 )
2023-08-30 07:17:38 -07:00
4dc5eb7912
Optimize read to max ( #1714 )
...
* optimize the ReadToMax.
* add comment.
* remove dumb comment.
* update comment.
* fix test.
* lint.
* address comments.
* use limit reader.
* update equality check.
* update test.'
* use custom limit reader.
* address comments.
* revert fun.
2023-08-29 17:31:40 -07:00
7ba880f47a
Add AvailableCapacity method to SourceManager ( #1665 )
2023-08-29 12:36:44 -07:00
2b1b1b5ad0
Add jobID to chunk. ( #1721 )
2023-08-29 12:02:30 -07:00
c51e8f8af5
buffer channel. ( #1718 )
2023-08-28 18:08:31 -07:00
66271aed7b
add detectors that were missed ( #1716 )
2023-08-28 18:02:11 -07:00
d1b1ac408e
Expired invite link fix ( #1713 )
2023-08-28 14:21:13 -05:00
0932ea224b
[chore] - Prevent nil deref panic ( #1709 )
2023-08-26 20:39:50 -07:00
5eb776cd61
Support cancelling a run from a JobProgressRef ( #1663 )
2023-08-25 10:43:33 -07:00
33eed42e17
Test S3 role assumption ( #1655 )
...
This PR adds a test of the S3 role assumption functionality. It currently only tests role assumption within a single account.
2023-08-25 11:30:08 -04:00
61977412df
Add SourceName to JobProgressRef ( #1664 )
2023-08-25 07:48:25 -07:00
4f4a79f62b
Support azure git links ( #1662 )
...
* Support azure git links.
* update comment.
* update test names.
2023-08-24 14:36:52 -07:00
f2bfcc7ac6
Capture source-reported progress in JobProgress snapshot ( #1661 )
2023-08-24 11:28:50 -07:00
a4401939a8
Add ElapsedTime method to JobProgressMetrics ( #1660 )
2023-08-24 11:28:33 -07:00
519646342e
add snowflake detector ( #1653 )
...
Detect Snowflake secrets (compound URI of account, username, password) and enrich Secret Result with account and databases that the secret has access to.
2023-08-24 13:29:58 -04:00
ahmed