Troubles with the site

Announcements about the board plus help for the n00bs. New members -- say howdy here! :hi5:
Plus how to register for the board
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

well, that's f*cked. I tried connecting from a new browser and got in some weird loop where it was sending me to the new expired session page. So I took out that code. And instantly we had almost 2k bots (but at least the site wasn't slow...).


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

What a conundrum. Turned the new code back on, number of bots immediately drops back down. But if it's hard to connect to the site for legitimate users, what's the point? :/

I'll give cloudflare a try and see what happens there.


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

I've removed the code that redirects to expired.htm because that had set me into some bizarre loop that I had to do "a thing" that nobody else ever would have thought of to break out of it. But I left in the code that I think is part of what is causing the bots to go crazy. We'll see if it works. The number of bots immediately shot up (boggles my mind, tbh), but the site still seems quite responsive, so we'll see what happens.


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

I'm glad to see actual users showing up now, so that's good! And the number of bots is dropping back down and the site is fully responsive, so... <crosses fingers>


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
smdub
DAMN Grand Poohba
Posts: 1032
Joined: Thu Oct 11, 2018 2:21 pm
Contact:

Re: Troubles with the site

Post by smdub »

Working here again.
Yeah, I pointed out the SSL thing ages ago.
Stephen (not Steve) - '20 Husky 701LR / KTM '20 500 EXC / '17 150 XC-W / '21 E-XC / '21 890R / '19 Sherco 300FST / Sur-Ron LBX / Segway X160 / Sur-Ron Ultra Bee
User avatar
juddspaintballs
DAMN Grand Poohba
Posts: 1912
Joined: Wed Nov 14, 2012 8:32 am
Contact:

Re: Troubles with the site

Post by juddspaintballs »

Yep, I got stuck in that loop after I posted everything was working. Thanks for fixing it.
2024 Husqvarna 701 Enduro
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

Okay, current strategy, since the site locked up while I was playing hockey last night --

I've signed up for the free tier of Cloudflare. Maybe it'll work, maybe it'll need the $20/mo version to get the "defense against 'not easily identifiable bots'" feature instead of just "block 'easily identifiable bots'" that the free tier gets. This is already active, but it could take 24 hours for people's DNS records to get updated to go through Cloudflare instead of direct.

On the "accessing the site directly instead of cloudflare" note, clearly some/many bots are still using the old DNS entry pointing straight at the site because as soon as I turned off the splash screen, the number of guests shot up to 2000 again. Rather than going back to the splash screen, I had the thought where I would re-enable the old redirect code to instead of pointing to the "expired session" page, it redirects to the front page. I think this will be better and avoid the infinite redirect loop previously experienced because I think that once you are logged in, the loop is broken based upon the code. Then again, as I type this, I realize that could still be the case because I suspect that you won't be able to get to the login page if this odd loop occurs. *sigh*

BTW, for the curious -- this is what we're dealing with. We are not alone. https://www.phpbb.com/community/viewtop ... 08600ac302


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

lol, okay that was entirely foreseeable. My cellphone got into the "expired session" tango, which caused the browser to hit the "expired" code, get redirected to "/", where it hit the "expired" code, which redirected me to "/", which hit the "expired" code, which... And my browser gave up as it should.

So I've removed that code again.

Back to the "we're not alone" -- https://www.phpbb.com/search/?q=bots (sort by date)

It seems everyone and their brother is beating up the Internet with crappy AI bots looking for data. People have been having good results with Cloudflare's free service, perhaps with some WAF settings added. I'm going to avoid using "under attack mode" for now, and I'm going to give CF some time to propagate and see what happens before I do anything.


~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

Oh, CF's analytics are fun. I didn't know we were so popular in Singapore, Brazil, and Vietnam :eyeroll: --

Top Traffic Countries / Regions
Previous 24 hours
Country / Region Traffic
Singapore 65,337
Brazil 21,877
Vietnam 18,059
Indonesia 1,846
United States 1,316
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
User avatar
phoo
Benevolent Dictator
Posts: 2440
Joined: Wed Sep 08, 2010 11:38 am
Contact:

Re: Troubles with the site

Post by phoo »

I tried to use CF's URL redirects to shuffle those three countries plus a specific type of URL over to the "expired" page, but I couldn't get it to actually trigger. So I finally threw in the towel and enabled CF's "under attack" mode. This is why you had to click the checkbox to get in. But, it seems to be working, and you should only have to click on the box once / once in a while. I'll keep trying to be more clever (like enabling that checkbox only for "offensive countries"), but for now I'm going to call it "done enough" and go mow the lawn then work on bikes. I have a pile of them that need maintenance.

Let me know if you have problems again, and if you have problems feel free to text me.


Thanks,

~Patrick
2003 Triumph Sprint ST :: 2004 Suzuki SV650R
2016 Beta 300RR :: 2006 Suzuki DRZ400SM
1975 Harley FXE1200
Post Reply