89 commits

Author	SHA1	Message	Date
Kyle Drake	0ec1c20f56	blacklist -> blocklist for disposable emails	2020-08-03 19:38:30 +00:00
Kyle Drake	0eba98bffd	split out code to dedupe tags	2020-05-26 22:48:24 -07:00
Kyle Drake	e9b688e388	Update rake, hoe, disable over-verbose test warnings	2020-03-02 11:40:42 -05:00
Kyle Drake	a9e49d7cdd	Rake to dump list of screenshots for future ML research	2020-02-01 21:18:58 -08:00
Kyle Drake	b949154df0	sitemap: off by one like a boss	2019-10-10 14:57:46 -07:00
Kyle Drake	8070b8dd61	sitemap.xml.gz -> index.xml.gz	2019-10-10 10:47:03 +00:00
Kyle Drake	66868a352b	sitmap: remove index- prefixes	2019-10-10 03:37:09 -07:00
Kyle Drake	54ba54c936	sitemap: refactor for easier digesting	2019-10-10 03:21:51 -07:00
Kyle Drake	7e7548f4d9	direct link to sharded site sitemaps	2019-10-09 16:22:56 -07:00
Kyle Drake	d6d0d983a1	no changefreq for sitemaps	2019-10-09 15:54:24 -07:00
Kyle Drake	6957305fc0	sitemap: gzip everything	2019-10-09 15:34:07 -07:00
Kyle Drake	f84290f8f4	sitemap: improvements, fixes, add tags	2019-10-09 15:13:42 -07:00
Kyle Drake	8c24b9831c	sitemap gen index missing a char	2019-10-08 21:15:08 -07:00
Kyle Drake	116954a592	sitemap generation	2019-10-08 20:50:32 -07:00
Kyle Drake	e183ac32f6	dumper task for ml image classification work	2019-07-02 13:46:39 -07:00
Kyle Drake	bd23c94b65	new approach: compute score separately from real follower count, use db cache for score rather than total	2019-06-27 21:53:44 -07:00
Kyle Drake	6f7a6098a4	bugfixes and reforms to block filters	2019-02-03 21:54:01 -08:00
Kyle Drake	556bc9d2be	add more stuff to tmp turd list	2019-01-23 11:11:04 +00:00
Kyle Drake	0ba71bc1b6	use https link for stopforumspam	2019-01-19 12:09:49 +00:00
Kyle Drake	a733a3b742	Fix for blocked ip update script	2018-12-20 05:07:07 +00:00
Kyle Drake	bf2fec7cf9	rakefile task to prime redis proxy ssl	2017-06-29 11:17:24 -07:00
Kyle Drake	e6deaa05b9	remove sandbox for banned/deleted sites	2017-05-24 12:06:45 -07:00
Kyle Drake	04af230f8d	performance: denormalize count of followers	2017-04-02 20:47:06 -07:00
Kyle Drake	54422802e5	Switch to directory sharding model for site storage	2017-03-22 17:45:01 -07:00
Kyle Drake	2c6ef58e6f	nginx mapfile for subdomains to domains - switch to contact form from ... email	2017-02-28 14:50:21 -08:00
Kyle Drake	bedc08cb58	mechanism to report spam ips to stopforumspam	2017-01-11 17:16:40 -06:00
Kyle Drake	2b526d85ed	reduce sandboxing time, set to single threaded as an experiment	2016-12-12 06:34:19 +00:00
Kyle Drake	aa20d39141	no sandboxing for child sites	2016-10-30 18:38:33 -05:00
Kyle Drake	a75a02d653	purge_tmp_terds: a sewage system for /tmp	2016-08-16 12:14:56 -07:00
Kyle Drake	ed44cc5a17	Script to periodically renew certs (run with cronjob)	2016-06-28 03:50:03 +00:00
Kyle Drake	aa6cd46eeb	Tweaks to initial seed script	2016-06-21 23:01:08 +00:00
Kyle Drake	3d73172246	cert generation rake task	2016-06-21 11:29:33 -07:00
Kyle Drake	5a5845e890	certs stay in pem, openssl cannot do der for chained certs	2016-06-20 22:01:42 -07:00
Kyle Drake	060376acfe	compile letsencrypt ssl keys for map	2016-06-19 10:40:04 -07:00
Kyle Drake	927c34ed01	fix for mapfile format	2016-05-25 06:42:17 -04:00
Kyle Drake	7ef47038a8	mapping for sandboxed sites	2016-05-25 06:35:54 -04:00
Kyle Drake	71be5eeed7	nginx map gen into single dir	2016-05-25 03:08:52 -04:00
Kyle Drake	4b6001b6ef	Code to parse out tode exit nodes I might do something with later	2016-05-17 21:37:36 -04:00
Kyle Drake	76cb669659	validate against throwaway email addresses	2016-05-15 01:53:55 -04:00
Kyle Drake	fafca061b7	included in config, not needed in map file	2016-04-13 15:47:54 -07:00
Kyle Drake	5d4e5ec109	supporters intelligence for proxy servers	2016-04-13 15:19:54 -07:00
Kyle Drake	fda95b7f07	punycode support for domains, validate for registered domains	2016-02-17 23:15:12 -08:00
Kyle Drake	c42196e16d	updates to classifier primer	2016-01-01 01:52:21 -06:00
Kyle Drake	0487e0c95b	spam training script	2015-12-30 17:52:47 -06:00
Kyle Drake	242cc6e92d	experimental statistical language classification system	2015-12-28 14:32:43 -06:00
Kyle Drake	688dd6ea62	fix for blocked ip updater	2015-12-15 00:32:52 +00:00
Kyle Drake	4502771702	use site_files for storing directory information	2015-09-20 00:15:46 -07:00
Kyle Drake	8524bc9d17	compute scores script	2015-08-28 12:03:04 -07:00
Kyle Drake	48845f3435	flush empty index sites script	2015-08-28 12:02:29 -07:00
Kyle Drake	b5920d8ba8	Dedupe follows	2015-08-13 19:01:13 -05:00