Silicon Investor - Silicon Investor - New feature discussion

[VisionsOfSugarplums] Hi Dima, I can give you one, searched for 'gold', received results from 2010. Th...

VisionsOfSugarplums — 3/8/2026 11:18:14 AM

Hi Dima, I can give you one, searched for 'gold', received results from 2010. Thank you.

siliconinvestor.com

[SI Dmitry (code monkey)] Dear Thomas, Can you past the URL of a specific search where you are seeing pro...

SI Dmitry (code monkey) — 3/8/2026 10:56:17 AM

Dear Thomas,

Can you past the URL of a specific search where you are seeing problem results like this?

Thank you,

@Dima

[Thomas M.] When I search site-wide, it's pulling up posts from 10-15 years ago. When I sea...

Thomas M. — 3/7/2026 7:39:45 PM

When I search site-wide, it's pulling up posts from 10-15 years ago. When I search a specific thread, it's fine.

Tom

[Chartgod] Does a simple [common to many sites on the web] change log page w/dates page exi...

Chartgod — 3/1/2026 5:29:53 AM

Does a simple [common to many sites on the web] change log page w/dates page exist anywhere 'public' of the actual "new features" that have been discussed here and then actually implemented?

en.wikipedia.org

Other than things, that just makes the 'sysop' happy?

Thank you in advance,

An error has occurred in this page and has been logged.

[SI Dmitry (code monkey)] So, what's in it for SI? Multiply that by all the other bots and we get the perf...

SI Dmitry (code monkey) — 2/14/2026 3:37:25 AM

So, what's in it for SI? Multiply that by all the other bots and we get the performance hit while they get free data.

Presumably, we get discovery by users of those services, just like Google and other search engines. But until we find a proper mechanism to throttle these AI bots to reasonable crawl rates, we will have to shut down their access to SI content completely. Discovery has value to us up to the point it damages Member experience.

The earlier search endpoint abuse was a separate matter.

Of additional interest: shutting down non-authenticated access to SI messages yesterday resulted in a single-day record number of legitimate new account registrations on SI, at least for the past 14 years.

[S. maltophilia] 18 page requests per second So, what's in it for SI? Multiply that by all t...

S. maltophilia — 2/13/2026 11:28:48 PM

18 page requests per second

So, what's in it for SI? Multiply that by all the other bots and we get the performance hit while they get free data.

[greg s] Can Knight Sac go after them?

greg s — 2/13/2026 9:40:55 PM

[SI Dmitry (code monkey)] Anthropic's ClaudeBot has been making 18 page requests per second (70K pages per...

SI Dmitry (code monkey) — 2/13/2026 8:03:09 PM

Anthropic's ClaudeBot has been making 18 page requests per second (70K pages per hour), all day. That's just one crawler hitting one web server.

[Chartgod] Message 35426217

Chartgod — 2/13/2026 7:55:17 AM

[Kirk ©] Maybe it is a language issue as I don't have a clue what you want after trying t...

Kirk © — 2/12/2026 6:36:53 PM

Maybe it is a language issue as I don't have a clue what you want after trying to help so I'll throw in the towel and leave it to the staff here.

As Jeff Probst would say "I have nothing for you."

Good luck.

[Chartgod] But you are already "on that page" If you try that from here = 1 Subject 58264...

Chartgod — 2/12/2026 1:59:59 PM

But you are already "on that page"

If you try that from here = 1

Subject 58264

To get the 'full subject text search" one must first go to

Tools > Search > this Subject = [3 things so far] then Enter Google = 4 things

Is this result

siliconinvestor.com

As simply putting a "search this subject" here? [a real no-brainer]

Or am I posting to the WRONG THREAD MAYBE? About a new feature?

30 years into this site?

Would result with the human race using less eye movement and mouse action and finger clicking resulting in?

Yes, less heartbeats also [smile]

I wonder what Mister or Misses AI would say? [I know that answer with out asking]

[Kirk ©] I'm sorry as it must be rocket science... Or I have no clue what you are asking...

Kirk © — 2/12/2026 1:45:39 PM

I'm sorry as it must be rocket science...

Or I have no clue what you are asking so I'll leave you with this to show what I meant.

[Chartgod] Kirk? Here > Subject 58264 CTRL+F and type in Google = I just mentioned IT las...

Chartgod — 2/12/2026 1:20:08 PM

Kirk?

Here > Subject 58264

CTRL+F and type in Google = I just mentioned IT last message yet your CTRL+F can find it?

[Chartgod] So does mine, but try to find text in all these messages? In this subject? Or an...

Chartgod — 2/12/2026 1:17:26 PM

So does mine, but try to find text in all these messages? In this subject? Or any subject easily?

OK, You tell AMAZON to get rid of their global search = and see where they tell you to go -smile-

Or just think after each page of Google you had to click 2 links to get to a search box again?

Those are NO BRAINERS -sorry-

Or these guys

stockanalysis.com

[S. maltophilia] sites are dragging On your end. SI works fine for me today.

S. maltophilia — 2/12/2026 1:11:16 PM

[engineer] thanks much better now.

engineer — 2/12/2026 12:58:38 PM

[Kirk ©] My browsers allow "Control +F" to search any page. Much quicker than looking fo...

Kirk © — 2/12/2026 12:55:04 PM

My browsers allow "Control +F" to search any page. Much quicker than looking for that feature in different spots, if any, on infinite web site.

[Chartgod] Not at all -lol- but not sure about others, but today all day? Most sites are d...

Chartgod — 2/12/2026 11:42:57 AM

Not at all -lol- but not sure about others, but today all day?

Most sites are dragging-arse for me

Checking now > netscout.com

[S. maltophilia] Just a few dozen. Imagine if you were high profile. Any benefit to you?

S. maltophilia — 2/12/2026 11:17:38 AM

[Chartgod] BAD BOTS >> this is a 4 second example on 1 of my servers from 4 days ago Log...

Chartgod — 2/12/2026 11:07:40 AM

BAD BOTS >>

this is a 4 second example on 1 of my servers from 4 days ago

Log: 2026-02-08 10:16:40.022 in: 8.0.14.11:49207 -> 69.30.213.67:53 udp len=102B profile=udp_dest_53 2026-02-08 10:16:40.090 in: 47.252.82.250:53895 -> 69.30.213.67:53 udp len=109B profile=udp_dest_53 2026-02-08 10:16:40.190 in: 173.194.170.82:60207 -> 69.30.213.67:53 udp len=92B profile=udp_dest_53 2026-02-08 10:16:40.306 in: 192.178.95.84:52924 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:40.317 in: 172.253.13.155:50509 -> 69.30.213.67:53 udp len=103B profile=udp_dest_53 2026-02-08 10:16:40.473 in: 186.86.126.73:30524 -> 69.30.213.67:53 udp len=98B profile=udp_dest_53 2026-02-08 10:16:40.483 in: 192.178.116.156:51023 -> 69.30.213.67:53 udp len=97B profile=udp_dest_53 2026-02-08 10:16:40.599 in: 172.253.251.156:36487 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:40.623 in: 74.114.28.24:53366 -> 69.30.213.67:53 udp len=105B profile=udp_dest_53 2026-02-08 10:16:40.797 in: 173.194.98.22:52340 -> 69.30.213.67:53 udp len=100B profile=udp_dest_53 2026-02-08 10:16:40.823 in: 172.253.198.148:64245 -> 69.30.213.67:53 udp len=103B profile=udp_dest_53 2026-02-08 10:16:40.901 in: 81.176.228.2:10564 -> 69.30.213.67:53 udp len=101B profile=udp_dest_53 2026-02-08 10:16:40.913 in: 172.253.7.23:55124 -> 69.30.213.67:53 udp len=101B profile=udp_dest_53 2026-02-08 10:16:40.951 in: 172.217.32.16:62101 -> 69.30.213.67:53 udp len=101B profile=udp_dest_53 2026-02-08 10:16:40.985 in: 172.253.12.147:48954 -> 69.30.213.67:53 udp len=106B profile=udp_dest_53 2026-02-08 10:16:41.136 in: 173.194.91.147:50677 -> 69.30.213.67:53 udp len=97B profile=udp_dest_53 2026-02-08 10:16:41.335 in: 8.0.22.128:38157 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:41.414 in: 196.3.132.153:46754 -> 69.30.213.67:53 udp len=96B profile=udp_dest_53 2026-02-08 10:16:41.550 in: 213.136.88.86:51898 -> 69.30.213.67:53 udp len=95B profile=udp_dest_53 2026-02-08 10:16:41.810 in: 59.18.40.52:41176 -> 69.30.213.67:53 udp len=108B profile=udp_dest_53 2026-02-08 10:16:42.063 in: 146.112.136.80:42769 -> 69.30.213.67:53 udp len=102B profile=udp_dest_53 2026-02-08 10:16:42.068 in: 8.0.22.129:57574 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:42.156 in: 166.49.153.253:41447 -> 69.30.213.67:53 udp len=113B profile=udp_dest_53 2026-02-08 10:16:42.180 in: 194.88.93.22:52792 -> 69.30.213.67:53 udp len=102B profile=udp_dest_53 2026-02-08 10:16:42.248 in: 172.253.11.24:35053 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:42.391 in: 110.9.165.5:13136 -> 69.30.213.67:53 udp len=88B profile=udp_dest_53 2026-02-08 10:16:42.490 in: 8.0.22.140:55777 -> 69.30.213.67:53 udp len=94B profile=udp_dest_53 2026-02-08 10:16:42.492 in: 94.29.125.106:28615 -> 69.30.213.67:53 udp len=93B profile=udp_dest_53 2026-02-08 10:16:42.525 in: 173.239.23.84:54553 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:42.542 in: 172.253.237.16:37352 -> 69.30.213.67:53 udp len=98B profile=udp_dest_53 2026-02-08 10:16:42.757 in: 192.221.150.11:13860 -> 69.30.213.67:53 udp len=95B profile=udp_dest_53 2026-02-08 10:16:42.787 in: 146.112.139.73:1822 -> 69.30.213.67:53 udp len=101B profile=udp_dest_53 2026-02-08 10:16:42.967 in: 195.29.247.206:9566 -> 69.30.213.67:53 udp len=82B profile=udp_dest_53 2026-02-08 10:16:43.053 in: 168.95.43.206:40375 -> 69.30.213.67:53 udp len=102B profile=udp_dest_53 2026-02-08 10:16:43.261 in: 172.253.209.151:57156 -> 69.30.213.67:53 udp len=94B profile=udp_dest_53 2026-02-08 10:16:43.342 in: 172.217.43.156:40880 -> 69.30.213.67:53 udp len=102B profile=udp_dest_53 2026-02-08 10:16:43.385 in: 204.194.239.91:44277 -> 69.30.213.67:53 udp len=108B profile=udp_dest_53 2026-02-08 10:16:43.411 in: 3.18.132.6:39077 -> 69.30.213.67:53 udp len=107B profile=udp_dest_53 2026-02-08 10:16:43.441 in: 172.69.82.27:35806 -> 69.30.213.67:53 tcp len=82B flags=syn profile=tcp_dest_53 2026-02-08 10:16:43.454 in: 5.45.240.237:25632 -> 69.30.213.67:53 udp len=101B profile=udp_dest_53 2026-02-08 10:16:44.083 in: 195.29.247.176:46490 -> 69.30.213.67:53 udp len=106B profile=udp_dest_53 2026-02-08 10:16:44.152 in: 173.194.169.124:60674 -> 69.30.213.67:53 udp len=103B profile=udp_dest_53 2026-02-08 10:16:44.460 in: 74.125.73.88:62424 -> 69.30.213.67:53 udp len=111B profile=udp_dest_53 2026-02-08 10:16:44.591 in: 202.8.10.212:50632 -> 69.30.213.67:53 udp len=93B profile=udp_dest_53 2026-02-08 10:16:44.752 in: 192.178.116.26:39959 -> 69.30.213.67:53 udp len=99B profile=udp_dest_53 2026-02-08 10:16:44.757 in: 172.217.34.17:48023 -> 69.30.213.67:53 udp len=108B profile=udp_dest_53

[S. maltophilia] stops good bots I didn't know there were any. Outside of some alleged SEO, whi...

S. maltophilia — 2/12/2026 10:33:56 AM

stops good bots

I didn't know there were any. Outside of some alleged SEO, which everyone gets, there doesn't seem to be any benefit to being crawled. Most humans don't search more than one or two items a minute. If there was a 30 second lockout after each query, the bots would get impatient and go away..

[Chartgod] Dear Dima, ty for the reply for sure = yes it is there and it takes 3-4 more s...

Chartgod — 2/12/2026 10:21:20 AM

Dear Dima, ty for the reply for sure

= yes it is there and it takes 3-4 more steps, to do what is "standard issue" in the 21st century on the vast majority of websites = a search option on each page

Just trying to IMPROVE the 20th century build here = I guess too complex [sorry]

And people who runs sites ? Really do not use them like "end users do"

All, fwiw from an 'interface expert" to make function & flow smoother, since the inceptions of a 'text entry box' Circa DOS 3.0 and up with Microsoft & Borland beta team [back in the day], and been programming since PAPER TAPE where one mistake = lost your job crashing a 1/2 million dollar machine tool in the 1970's

[SI Dmitry (code monkey)] Dear Chartgod, Click the Search button on the top right. You will see this fea...

SI Dmitry (code monkey) — 2/12/2026 9:50:46 AM

Dear Chartgod,

Click the Search button on the top right. You will see this feature already exists, and it has for many years. When you are on a subject "This Subject" becomes one of the search boxes you can use.

Regards,

@Dima

[Chartgod] @dimi ty for great work isolating what you can so far Speaking of 'search' an...

Chartgod — 2/12/2026 7:43:10 AM

@dimi

ty for great work isolating what you can so far

Speaking of 'search' and now that you are addressing it globally also, I had asked many years ago, maybe I think it was the day after they threw "Jesus Christ" up to hang, about "per subject" of throwing it on the page you are on >>> the "search this subject" right on the page? = Saves mousing around and hunting time

In front of > Go to reply# or date (mm/dd/yy):

As I am able to 'read between the lines' but that skill does not allow me to "guess text" and then allow me to know and go to EXACT reply # or date that I need to "locate that text"

As it makes IT so much easier for us humans then to "take a look/see" to see if something is already posted, to save seeing the same things over & over, increasing disk space & cpu usage ;-)

[SI Dmitry (code monkey)] Dear engineer, We may have found the issue. You can search for generic text ...

SI Dmitry (code monkey) — 2/12/2026 6:16:39 AM

Dear engineer,

We may have found the issue.

You can search for generic text in our message database using the Search button at the top of pages. It looks like several bots are abusing this. SemrushBot, Amazonbot, PetalBot, bingbot and Applebot are the ones we found in the last hourly log alone. This uses a lot of SI resources and can bog down our network, our database servers and our webservers. These engines appear to be looking up huge numbers of keywords and stock symbols quite regularly through our search engine intended for our users.

We've addressed the problem in two ways:

A) We optimized a problem in the stored procedure used to return these search results in a manner that greatly mitigates this issue. Pages returned from search result queries come back at the very least an order of magnitude faster now.

B) We updated our robots.txt file to disallow crawling via our search page. This change alone should drop 80-95% of the traffic to the search page immediately.

This second mitigation stops good bots. There are additional mitigations we can do to stop bad bots. But let's step back and see how things are at this point.

Regards,

@Dima

[engineer] ok, so I signed on in the middle of the night when there should be way way less ...

engineer — 2/12/2026 3:03:54 AM

ok, so I signed on in the middle of the night when there should be way way less traffic and I am waiting a long time after each mouse click for a spinning wheel. This changed like 2 weeks ago and has been bad ever since. Unless you actually DROPPED servers, you system is messed up.

[SI Dmitry (code monkey)] Message 35422799

SI Dmitry (code monkey) — 2/10/2026 1:05:14 PM

[engineer] servers are very SLOOOOWWWWWW....

engineer — 2/9/2026 8:56:50 PM

[Don Green] For those who prefer dark mode on their websites, here’s a great extension to ma...

Don Green — 1/31/2026 5:12:18 PM

For those who prefer dark mode on their websites, here’s a great extension to make it happen. SI has always been too bright for my taste. This version is for Microsoft Edge, but there are similar versions available for Chrome and other browsers.

Message 35413946

[Kirk ©] Quite often SI won't let me upload an image that is well under the 5MB limit. I...

Kirk © — 12/31/2025 12:01:19 PM

Quite often SI won't let me upload an image that is well under the 5MB limit.

I made two nearly identical images with AI today and it let me do the first but not the second.

This works

Happy New Year 2026 Kirk's Stock Market Thoughts.png

does not

Happy New Year

[SI Ron (Crazy Music Man)] Happy New Year 2026 Also a video I took Jan 1 2000 while on SI trying to get th...

SI Ron (Crazy Music Man) — 12/31/2025 7:52:51 AM

Happy New Year 2026

Also a video I took Jan 1 2000 while on SI trying to get the first post of the year. (Y2K)

[S. maltophilia] A few minutes ago Malwarebytes blocked a connection to s.groamth.com Since SI is...

S. maltophilia — 12/30/2025 1:09:11 PM

A few minutes ago Malwarebytes blocked a connection to s.groamth.com Since SI is the only thing open on a browser that isn't thoroughly battened down against ads and cookies, I suspect one of our ad networks.

Anyone else see this, or heard of groamth.com?

[Chartgod] YES, I saw same box and right clicked to open image or link [I forget which] = ...

Chartgod — 12/24/2025 1:25:34 PM

YES, I saw same box and right clicked to open image or link [I forget which] = warning of going to site www2 etc

[SI Dmitry (code monkey)] Fixed, thanks.

SI Dmitry (code monkey) — 12/24/2025 12:54:33 PM

[EL KABONG!!!] I can't see the e-mail address. All I see is a square "box" (file symbol or what...

EL KABONG!!! — 12/24/2025 12:32:34 PM

I can't see the e-mail address. All I see is a square "box" (file symbol or what looks like a floppy disk with the upper right corner dog-eared)...

EK!!!

[SI Dmitry (code monkey)] Dear New Feature Discussion participants, We are aware that one of our web serv...

SI Dmitry (code monkey) — 12/24/2025 11:41:20 AM

Dear New Feature Discussion participants,

We are aware that one of our web servers has encountered performance bottlenecks twice over the past two days. We have been able to resolve the condition in these instances by restarting the web service, but have not yet been able to identify the underlying cause.

Please PM me or use the e-mail address below to bring any operational issues to my attention over the holiday weekend.

Regards,

@Dima

[SI Ron (Crazy Music Man)] I will be off Dec 25 to Dec 29th. Any problems please contact Dmitry. If it's...

SI Ron (Crazy Music Man) — 12/24/2025 6:54:27 AM

I will be off Dec 25 to Dec 29th. Any problems please contact Dmitry. If it's small I can handle it when I return.

Dec 26 is Boxing Day in Canada

Merry Christmas

SI Ron

[SI Dmitry (code monkey)] Dear Members, I was able to experience and investigate some major site performa...

SI Dmitry (code monkey) — 11/1/2025 2:15:51 PM

Dear Members,

I was able to experience and investigate some major site performance problems this morning that were causing pages to take an extended period to load. I suspect everyone was encountering this today. I did find the cause the issue; corruption in a high use SQL table that is written to several times on each page view. We've seen this a few times before some years ago, and the solution is to nuke and re-create the table. I believe the issue should now be resolved and the site should be flying again.

We sincerely apologize for the poor SI use experience that resulted before this issue was resolved.

Regards,

@Dima

[philv] Hope it's informative for Dimitry.

philv — 10/29/2025 12:02:56 PM

[Chartgod] [graphic]

Chartgod — 10/29/2025 11:57:41 AM

[philv] I confirm, it hangs up for a long time -- again.

philv — 10/29/2025 10:22:45 AM

[Bill] It's a little slow today as well.

Bill — 10/29/2025 10:16:24 AM

[Ron] I agree... seems variable. Sometimes it takes a minute or two for a board or mes...

Ron — 10/27/2025 6:20:26 PM

I agree... seems variable. Sometimes it takes a minute or two for a board or message to load. Other times
it is OK. US East coast, if that makes a difference.

[wilywilly] All day long it comes and goes. lightning fast response for several posts, then ...

wilywilly — 10/27/2025 4:06:33 PM

All day long it comes and goes. lightning fast response for several posts, then S-L-O-W response for several. Nothing else I access on the web has the issue, seems limited to SI, from San Diego on Spectrum cable modem.

[Chartgod] oThat I honestly am unsure of, as it has been at least a year since I had been t...

Chartgod — 10/27/2025 12:47:06 PM

oThat I honestly am unsure of, as it has been at least a year since I had been to it.

I was just trying to isolate things, but while on this site, and it 'dragging' I noticed lower left this while it was hanging and emailed Ron [as was unable to post here]

So, just another snooper added here, and I have not checked just who/what/why pbxai.com is/does and why IT's even on here [other than} Yup, record your every MOVE possibly

Waiting for api.pbxai.com

https://www.scamadviser.com/check-website/floor.pbxai.com

[SI Ron (Crazy Music Man)] I let Dmitry know about the slow down.

SI Ron (Crazy Music Man) — 10/27/2025 12:13:32 PM

[S. maltophilia] Interesting. The recent attacking countries don't to be the usual suspects we re...

S. maltophilia — 10/27/2025 12:11:11 PM

Interesting. The recent attacking countries don't to be the usual suspects we read about as hacker havens. Is that site complete in its coverage?

[Chartgod] Could be just a busy day in "PARADISE" livethreatmap.radware.com

Chartgod — 10/27/2025 12:04:14 PM

[philv] Same experience here. I posted a reply, but it apparently didn't go through. ...

philv — 10/27/2025 11:58:54 AM

Same experience here. I posted a reply, but it apparently didn't go through.

I tried a different browser, but the same result. I put on an ad blocker to see if that would speed things up, ... it didn't.

The past week was difficult. Today it is unusable.

[S. maltophilia] Very slow here, too. Has not recovered. Edit: Good now.

S. maltophilia — 10/27/2025 11:55:33 AM