Commit Graph
55 Commits
Author SHA1 Message Date
Olivier Cervello 9773d03e77 Merge branch 'add-json-output' of https://github.com/ocervell/cariddi into add-json-output 2023-03-22 13:37:15 +00:00
Olivier Cervello 04a4d97896 omit values when empty structs 2023-03-22 13:35:54 +00:00
Olivier Cervello 1d28243dab split content-type to remove charsets 2023-03-21 14:20:44 +00:00
Olivier Cervello 03d9ce059b fix linting 2023-03-21 14:10:16 +00:00
Olivier Cervello 4f40416f8c update event structure to add JSON bool flag 2023-03-21 10:41:41 +00:00
Olivier Cervello e199bf63e1 merge devel into branch 2023-03-21 10:22:24 +00:00
edoardottt 855253c240 Fix data image protocol link 2023-02-27 19:18:04 +01:00
edoardottt fc1455efa7 Add 5 new secrets 2023-02-27 19:10:35 +01:00
edoardottt b965684213 v1.3.0 2023-02-12 15:57:29 +01:00
edoardottt 37c71bbfef fix false positives 2023-02-12 15:56:24 +01:00
edoardottt 339cd7b896 refactor collector 2023-02-12 11:59:36 +01:00
edoardottt c8b843f6dc fix s3 rule 2023-02-11 17:08:52 +01:00
Olivier Cervello a6b6288de6 fix boolean flag 2023-02-03 17:54:56 +00:00
Olivier Cervello 4b0689bbff update 2023-02-03 17:53:20 +00:00
Olivier Cervello 81aef1ecd7 update 2023-02-03 17:49:28 +00:00
Olivier Cervello 7f3077a24e update to devel branch 2023-02-03 17:38:09 +00:00
Olivier CervelloandGitHub 37e5316704 Merge branch 'devel' into add-json-output 2023-02-03 18:24:38 +01:00
Olivier Cervello 3baf1946bf add json output to Parameter 2023-02-03 17:15:22 +00:00
Olivier Cervello 7d76368b82 update 2023-02-03 16:47:01 +00:00
Olivier Cervello bc927a1e23 update 2023-02-03 16:45:32 +00:00
Olivier Cervello b22d12e9fa update 2023-02-03 16:43:05 +00:00
Olivier Cervello 702ec9915d Add JSON lines output capability to cariddi 2023-02-03 15:39:27 +00:00
edoardottt 806a69a23b fix endpoints 2022-12-15 20:49:26 +01:00
edoardottt c1de7ff999 update BTC address regex 2022-12-15 20:38:43 +01:00
edoardottt b5d63417f7 fix robots and sitemap 2022-12-08 12:11:17 +01:00
edoardottt 43fe15cf58 Fix Slack webhook regex 2022-11-21 21:21:45 +01:00
edoardottt 7ce0f4e739 insecure by default 2022-11-18 21:32:27 +01:00
edoardottt eb9a91e268 linting 2022-11-17 08:31:03 +01:00
Cedric Brisson c5159977f6 Fix linting issues 2022-11-16 19:49:30 -05:00
Cedric Brisson 314323364e Fixes issue 95. Now that we have a solid object as a reference, we should be able to next redundant lines :) 2022-11-16 19:44:22 -05:00
Cedric Brisson 9163400fda fix linting 2022-11-16 08:59:37 -05:00
Cedric Brisson f1c1bdc8d0 fix https://github.com/edoardottt/cariddi/pull/97/files/a21f6d3a7db4ea817052dadfc20c793b5b0e2fcf#r1023601615 2022-11-16 08:57:36 -05:00
Cedric Brisson a21f6d3a7d Fixed linting issue 2022-11-15 17:29:26 -05:00
Cedric Brisson 3a83d1f79b Fixes issue #94 2022-11-15 17:16:30 -05:00
Cedric Brisson ec331cf39a Moved functions that were not strictly attached to colly into a 'utils' file for better readability 2022-11-15 16:49:38 -05:00
edoardottt 1860df8b9c v1.2.1 2022-11-15 18:53:58 +01:00
edoardottt b90dc40cbb Fix slice bounds out of range #88 2022-11-15 18:48:14 +01:00
edoardottt c547128798 Fix Second ctrl+c should force quit the program #89 2022-11-15 16:54:08 +01:00
edoardottt 566f3b1a9a v1.2.0 2022-11-15 15:41:37 +01:00
edoardottt be3268f994 v1.2 2022-11-15 14:50:44 +01:00
edoardottt 7ab8e0a9eb Linting 2022-11-15 14:48:07 +01:00
edoardottt b4c7b133f0 Add CTRL-C handle 2022-11-15 14:42:50 +01:00
vrenzolaveraceandGitHub 861dcdaefe Merge pull request #83 from edoardottt/main
update
2022-11-15 14:17:25 +01:00
edoardottt ba714c026b Fix user agent 2022-11-15 14:16:05 +01:00
edoardottt d9d74ed498 Fix Initial call - ignore (#81) 2022-11-15 13:55:54 +01:00
Cedric Brisson fa8ea89b10 Use c.OnRequest to print the URL that is actively being crawled rather than the URL it scrapped from a page 2022-11-14 17:29:35 -05:00
Cedric Brisson 4ae6be404e simplify the final list append (recommended by go-staticcheck). Instead of iterating through the list, we simply unfurl it and append it to the final list (again) 2022-11-14 17:17:07 -05:00
Cedric Brisson e4cfd30d49 simplify the final list append (recommended by go-staticcheck). Instead of iterating through the list, we simply unfurl it and append it to the final list 2022-11-14 17:13:34 -05:00
edoardottt da540eba55 update ignore 2022-11-14 21:36:41 +01:00
edoardottt e52c4ae792 Fix #78 2022-11-14 21:18:40 +01:00