Free Lessons
Courses
Seminars
TechHelp
Fast Tips
Templates
Topic Index
Forum
ABCD
 
Home   Courses   TechHelp   Help   Contact   Merch   Join   Order   Logon   Forums   
 
Back to Access Forum    Comments List
Upload Images   @Reply   Bookmark    Link   Email   Next Unseen 
Pulling Text From Webpage
Jerry Fowler 
       
37 days ago
Still playing with my TechHelp Database. I had come across an article, and it started me thinking. Right now, I use a get statement for each item that I want data for, such as Title, Description, Transcript, Keywords...
After reading the article, I thought, why not pull the data once and then search through that data for what I need. So I came up with the following routine to "GET" the page once and save it to a textbox on a form.

DetailsPublic Function Get599Section(BlogID As Long) As String
    Dim Http As Object
    Dim HTML As String
    Dim StartPos As Long
    Dim EndPos As Long
    Dim FindText As String

    Set Http = CreateObject("MSXML2.ServerXMLHTTP.6.0")

    Http.Open "GET", _
        "https://599cd.com/blog/display-article.asp?ID=" & BlogID, _
        False

    Http.SEnd

    HTML = Http.ResponseText
    
    StartPos = InStr(HTML, "<details><summary>")

    If StartPos = 0 Then Exit Function

    EndPos = InStr(StartPos, HTML, "</span>")

    If EndPos = 0 Then Exit Function

    HTML = Mid$(HTML, StartPos, EndPos - StartPos)
    
    Forms!GetTechHelpF.ResponseText = HTML
    
End Function


After trying this 6 or seven times, I got blocked from Richard's site (and rightfully so after Richard showed me what was happing.) Does anything pop out to you guys? Last thing I did not receive any errors running this, plus nothing in my textbox on the form.
Jerry Fowler OP  @Reply  
       
36 days ago
I have been able to fix both problems since I posted this. The problem with this was that the GetTechHelpF form wasn't loaded yet. I also see why I was hitting Rick's site so much. In the loop, I had to get to the right record, it was hitting the webpage for each record several times before it. I started over on the recordset, and I am only hitting Rick's site once to get the HTML from the site.

Again, Rick, I am very sorry for the trouble
Darrin Harris  @Reply  
     
36 days ago
Hi Jerry

That's good your only hitting Ricks site once now, I'm entering the web data as I watch them, done around 1500 now.
Almost finished.
Jerry Fowler OP  @Reply  
       
36 days ago
Wow, 1500, what does that include other than TechHelp videos? I save them separately, the QuickQueries and the ones that Alex does. I know I'm missing some of his, but I have all the Quick Queries. I have 1164 of the TechHelp videos. It's a work in progress.
Darrin Harris  @Reply  
     
36 days ago
It sure is a work in progress, but it makes it a lot easer to find keep track of and take notes for every video.

It includes all YouTube video links and web links, mainly Tech Help.
Darrin Harris  @Reply  
     
36 days ago

Darrin Harris  @Reply  
     
36 days ago

Sandra Truax  @Reply  
         
36 days ago
Darrin I love this idea. I'm wondering if I could get it to work. You did good!
Darrin Harris  @Reply  
     
36 days ago
Thankyou Sandra

I'm sure you could, I've been working on a new database that imports YouTube straight into Access.
I have about five sites so far:

Computer Learning zone of course
DanielPineault
SeanMackenzie

and others.
Darrin Harris  @Reply  
     
36 days ago

Richard Rost  @Reply  
          
11 days ago
Darrin, that is an impressive database. Very cool.

And Jerry, no worries at all. Just be aware that a lot of websites, including mine, use protection software. I use Cloudflare, so if one IP address starts hitting the site faster than a human could reasonably read pages, it can lock you out. I think mine is throttled at around 50 hits per minute. If someone pulls more than 50 pages in a minute, it is definitely a bot, because no human can read that fast. Lol.

Pulling each page once, saving the HTML, and then parsing everything you need from that local copy is definitely the right approach. If you are doing a larger import, just slow it down and add a short delay between requests too.
Darrin Harris  @Reply  
     
11 days ago
Just Finishing up this one Richard, making sure all the links are working.
Darrin Harris  @Reply  
     
11 days ago

Darrin Harris  @Reply  
     
11 days ago

Darrin Harris  @Reply  
     
10 days ago
Hi Richard

I only found 7 Links that are not working
that's not bad for 1514 Links

https://599cd.com/CopySameField
https://599cd.com/DirectSQLView
https://599cd.com/Don'tLoseData
https://599cd.com/QQ18
https://599cd.com/SelectMultipleRecords
https://599cd.com/MsgBoxOptions2
https://599cd.com/TooFewParameters
Richard Rost  @Reply  
          
10 days ago
Oh wow, thank you for compiling that, Darrin. I've had it on my to-do list to make a routine that checks all of the links, because those are stored in a separate TinyURL redirect table. Sometimes an entry gets added there and then the destination page moves or changes later.

I really appreciate you taking the time to find those. Thank you.
Darrin Harris  @Reply  
     
10 days ago
Your Welcome If I find any more I'll let you know
Darrin Harris  @Reply  
     
10 days ago
Found 2 more

https://599cd.com/DarkModeChrome
https://599cd.com/DebunkingMyths

SelectMultipleRecords should be SelectRecords and is working.
Don'tLoseDate should be DontLoseDate still not working
Richard Rost  @Reply  
          
9 days ago
All right, I think I got them all. Thanks for hunting those down for me. The only one that I can't find is the "Don't Lose Data" one. I see the page. It does have a link. It's DontLoseData without the single quote, but I can't find any incoming links that go to that page with the single quote in them. If you found a page that links to that, wrong, let me know and I'll change it. I did a global search on my site. I couldn't locate it.
Darrin Harris  @Reply  
     
9 days ago
Awesome

I've tested them all Thankyou all working now.

This is the link for Don't lose data the single quote is in the name?

Don't Lose Data: https://599cd.com/DontLoseData

I haven't found anymore so all good, great job Richard

Just have to finish this database now :)
Richard Rost  @Reply  
          
9 days ago
No... thank YOU. :)
Add a Reply Upload an Image
Next Unseen

 
New Feature: Comment Live View
 
 

The following is a paid advertisement
Computer Learning Zone is not responsible for any content shown or offers made by these ads.
 

Learn
 
Access - index
Excel - index
Word - index
Windows - index
PowerPoint - index
Photoshop - index
Visual Basic - index
ASP - index
Seminars
More...
Customers
 
Login
My Account
My Courses
Lost Password
Memberships
Student Databases
Change Email
Info
 
Latest News
New Releases
User Forums
Topic Glossary
Tips & Tricks
Search The Site
Code Vault
Collapse Menus
Help
 
Customer Support
Web Site Tour
FAQs
TechHelp
Consulting Services
About
 
Background
Testimonials
Jobs
Affiliate Program
Richard Rost
Free Lessons
Mailing List
PCResale.NET
Order
 
Video Tutorials
Handbooks
Memberships
Learning Connection
Idiot's Guide to Excel
Volume Discounts
Payment Info
Shipping
Terms of Sale
Contact
 
Contact Info
Support Policy
Mailing Address
Phone Number
Fax Number
Course Survey
Email Richard
[email protected]
Blog RSS Feed    YouTube Channel

LinkedIn
Copyright 2026 by Computer Learning Zone, Amicron, and Richard Rost. All Rights Reserved. Current Time: 8/7/2026 12:32:52 PM. PLT: 1s