2214 Commits

Author SHA1 Message Date
ahrav d3d551d24e [chore] - Update Chunk struct comment (#2317)
* update comment to include information on the importance of struct ordering

* more cute tricks

* remove cute tricks
2024-01-20 13:31:27 -08:00
ahrav 8380e1713e save 8 bytes per chunk (#2310) 2024-01-18 13:20:06 -08:00
ahrav b0fd951652 [chore] - Add regex and keyword for api_org tokens (#2240)
* Add regex and keyword for api_org tokens.

* handle org token auth struct

* update keywords
2024-01-16 15:25:26 -08:00
Miccah c5af979aee Assume unauthenticated github scans have public visibility (#2308) 2024-01-16 14:57:06 -08:00
ahrav a1dc660f41 [fixup ] - Allow ssh cloning with AWS Code Commit (#2307) 2024-01-16 11:55:17 -08:00
roxanne-tampus d6419a8ab2 added azure protos (#2304) 2024-01-15 06:59:47 -08:00
Dustin Decker 2596331bca Disable recently added postgres detector because it it too sensitive (#2303) 2024-01-13 19:52:57 -08:00
Cody Rose b03cc30263 Individuate archive tests #2293 2024-01-12 09:39:48 -05:00
ahrav 651beff492 [feat] - Allow for the use of include/exclude path files for filesystem scans (#2297)
* Allow for the use of include/exclude path files for filesystem scans

* remove oopsie
2024-01-11 15:41:50 -08:00
ahrav 9408425cc6 [chore] - small updates (#2288)
* small updates

* fix logic

* simplify fxn

* remove errors

* use strings.EqualFold
2024-01-11 14:27:10 -08:00
ahrav 677238c96c Extend memory cache (#2275)
* Extend memory cache to allow for configuring custom expiration and purge interval

* use any for value type

* fix test

* fix test

* address comments

* address

* make new construct more clear

* reduce duplication

* fix test
2024-01-11 08:20:37 -08:00
dylanTruffle 3b4518cbab adding postgres detector (#2108)
* adding postgres detector

---------

Co-authored-by: Chair <chair@Chairs-MacBook-Pro.local>
Co-authored-by: ahmed <ahmed.zahran@trufflesec.com>
2024-01-10 16:19:45 -05:00
ahrav fb927e011b update test (#2283) 2024-01-10 09:56:21 -08:00
Richard Gomez 04bf244f38 fix(signable): ignore common false positives (#2230) 2024-01-09 17:53:25 -08:00
Richard Gomez 38f36475de fix(parseur): ignore false positives (#2229) 2024-01-09 17:50:30 -08:00
ahrav b2c0d50ba8 [chore] - update docs for pre-commit (#2280)
* update docs for pre-commit

* fix spacing
2024-01-09 15:41:27 -08:00
David 24a09bc37d 1833 Fix syslog udp (#1835)
* # 1183 - Update syslog UDP listener deadline

* #1833 - Update syslog UDP listener deadline v2

* #1833 - Update syslog UDP listener deadline v3
2024-01-08 09:59:48 -08:00
Cody Rose fd8e5e9df6 Wrap temp deletion err #2277 2024-01-08 12:48:58 -05:00
Shivasurya e5289ac8e4 Updated trufflehog sourcegraph secret format (#2254) 2024-01-06 08:48:41 -08:00
NIKHIL PANWAR 7365dba9c9 Update stripe detector regex (#2261) 2024-01-06 08:43:39 -08:00
Miccah 5e78ad402e [chore] Add test to check all versioned detectors are non-zero (#2272) 2024-01-05 12:06:59 -08:00
Richard Gomez 241e153dfb fix(gitparse): handle fromFileLine edge case (#2206) 2024-01-04 14:53:08 -08:00
Dustin Decker 1cc41e2c75 Use directory iterator instead of walkdir (#2260)
* Use directory iterator instead of walkdir

* pr comments
2023-12-22 22:45:27 -08:00
Bill Rich 78d8dd3abf Add handlerOpts back (#2258) 2023-12-22 12:11:59 -08:00
Bill Rich ceff786db4 Skip all binaries (#2256)
* Skip all binaries

* Remove noop

* Drop handlerOpts
2023-12-22 12:01:07 -08:00
Dustin Decker 7d93adc1d0 Add skip archive support (#2257) 2023-12-22 11:55:23 -08:00
Dustin Decker f699f60e89 use walk dir for tmp cleanup (#2255) 2023-12-22 07:52:58 -08:00
ahrav 39f0310f1f [fixup] - Refactor to Pass Reader for Binary Diffs and Archived Data; Optimize /tmp Directory Cleanup (#2253) 2023-12-22 07:41:54 -08:00
Cody Rose 9c8674777c Dedupe some source log keys (#2250)
The source manager attaches some context keys, but in certain circumstances, they're already present, resulting in duplicate keys. This PR changes the attachment to be conditional. It also adds some new log messages to track source startup progress.
2023-12-21 10:11:52 -08:00
ahrav 07ae9ec870 Fix goroutine leak (#2251) 2023-12-20 21:09:05 -08:00
ahrav 28212c9a82 [chore] - lower logging level (#2249)
* lower logging level

* move pid len check outside loop
2023-12-20 09:50:32 -08:00
ahrav 4a66dddd81 [chore] - add additional binary extensions to skip (#2235)
* add additional binary extensions to skip

* remove whl
2023-12-20 06:57:23 -08:00
ahrav f5d0f3f366 use snake_case for naming (#2238) 2023-12-20 06:57:00 -08:00
ahrav 5848f5b8d6 [bug] - Bug archive handler memory leak (#2247) 2023-12-20 06:16:58 -08:00
Dustin Decker 6b90a96ca0 Add missing import (#2246) 2023-12-19 16:40:31 -08:00
Richard Gomez 69d5e0c993 fix(snowflake): avoid extraneous attempts (#2057)
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2023-12-19 16:04:08 -08:00
Richard Gomez 97afd570ae feat(github): update extradata (#2219) 2023-12-19 16:01:07 -08:00
Mike Vanbuskirk adba91da50 Adds basic if/else check if pid slice is empty (#2244)
* adds basic if/else check for pid slice

* use continue instead of if
2023-12-18 22:24:49 -05:00
ahrav 64c7365364 add secretID to chunk (#2242) 2023-12-18 15:27:49 -08:00
Richard Gomez eeb4dbd304 feat(shortcut): use tri-state verification (#2211) 2023-12-17 15:47:14 -08:00
Richard Gomez ded8e459bd feat(huggingface): enhance extradata (#2222) 2023-12-17 14:29:45 -08:00
Richard Gomez 69a70a3374 fix(myfreshworks): check for valid JSON (#2212) 2023-12-17 10:26:38 -08:00
Miccah 88281bc354 [chore] Add skip_binaries field to AzureRepos proto message (#2232)
* [chore] Add skip_binaries field to AzureRepos proto message

* Make protos
2023-12-15 12:23:46 -08:00
ahrav 5c6ce693c1 [feat] - Make skipping binaries configurable (#2226)
* Make skipping binaries configurable

* remove ioutil

* fix

* address comments

* address comments

* use multi-reader

* remove print

* use const

* fix test

* fix my stupidness
2023-12-15 11:46:27 -08:00
Miccah 78b5a95342 [chore] Prevent panic when ChunkError has a nil Unit (#2227) 2023-12-15 11:11:28 -08:00
Richard Gomez b3040b1227 fix(github): remove unused 'members' var (#2202) 2023-12-14 11:53:24 -08:00
Miccah f6bbc59bf6 Check for SourceUnit support dynamically in the SourceManager (#2205)
* Check for SourceUnit support dynamically in the SourceManager

* Only call the function if we can use source units
2023-12-14 11:48:15 -08:00
Richard Gomez 06b137fd93 fix(gitlab): check for valid JSON (#2218) 2023-12-14 11:22:06 -08:00
ahrav d8cb65833c Avoid reading decompressed data into memory (#2196) 2023-12-14 11:00:11 -08:00
Richard Gomez e72fdb62e4 fix(gitparse): don't trim filename (#2201) 2023-12-14 08:29:46 -08:00