This is a test post to check all features of the blog
Key Takeaways
This test article validates blog platform features including markdown formatting, code highlighting, image handling, and interactive elements for content creation.
- Test markdown formatting with headers, lists, code blocks, and custom shortcodes
- Validate image handling using relative paths, captions, dimensions, and alt text
- Implement tab functionality for switching between code examples and content sections
- Include external code files with proper syntax highlighting and formatting
- Use custom shortcodes for quotes, CTAs, and specialized content elements
links should apply rel target etc
external untrusted link
external trusted link
internal link
internal different domain link
named link
inspect these ☝️
custom markdown features
"page:" post url (should link to itself)
"page:" tag url (should link to /tags/python)
image.json cell
This cell should be able to render a relative ./wsdev-product1.webp image from the content/posts/test-everything/ directory.
video.json cell
This cell should be able to render a relative ./wsdev-product1.webp image from the content/posts/test-everything/ directory.
code cell
The code should be highlighted and rendered properly.
from scrapfly import ScrapflyClient, ScrapeConfig
client = ScrapflyClient(os.environ['SCRAPFLY_KEY']) # key should be replaced here with 'SCRAPFLY_KEY' string
async def main():
response = await client.scrape(ScrapeConfig(
url="https://web-scraping.dev/testimonials",
render_js=True,
))
print(response.content)info.md cell
test shortcodes
NOTE: many shortcodes are mostly legacy and should be avoided in new posts if possible
% include %
% img %
% url %
% tref %
using api clients for web scraping
% ref %
% legal %
Legal Disclaimer and Precautions
This tutorial covers popular web scraping techniques for education. Interacting with public servers requires diligence and respect:
- Do not scrape at rates that could damage the website.
- Do not scrape data that's not available publicly.
- Do not store PII of EU citizens protected by GDPR.
- Do not repurpose entire public datasets which can be illegal in some countries.
Scrapfly does not offer legal advice but these are good general rules to follow. For more you should consult a lawyer.
% pitch %
% green %
success!
% red %
error!
% github %
as a heading:
[% github amazon-scraper heading="Latest Amazon.com Scraper Code" %]
and a text:
[% github amazon-scraper title="Latest Amazon.com Scraper Code" %]
% cta %
% ctaextraction %
% ctawebscraping %
% ctascreenshot %
% ctablocking %
% quote-cta-extraction %
[% quote-cta-extraction %]
Markdown images
relative image with attributes
Tabs
Some text in the tab
[%include code/tab3.py python %]
