Content Automation

Automate content workflows: scrape web pages, convert formats, and process documents at scale.

Quick Reference: All requests go to POST /api/services/execute with your API key in the Authorization: Bearer YOUR_API_KEY header.

Web Scraping & Content Extraction

Service: url-to-markdown

Extract clean, readable content from any web page. Perfect for building knowledge bases, archiving articles, or feeding content to AI systems.

Archive a Blog Post for Your Knowledge Base

Save an article as clean markdown for your internal documentation system.

curl -X POST https://www.acrewity.com/api/services/execute \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "service": "url-to-markdown",
    "operation": "url_to_markdown",
    "parameters": {
      "url": "https://blog.example.com/scaling-nodejs-applications"
    }
  }'

Extract Product Information for Comparison

Pull product details from competitor sites for market research.

// JavaScript - Extract and process product pages
const products = ['https://competitor.com/product-a', 'https://competitor.com/product-b'];

const results = await Promise.all(products.map(async (url) => {
  const response = await fetch('https://www.acrewity.com/api/services/execute', {
    method: 'POST',
    headers: {
      'Authorization': 'Bearer YOUR_API_KEY',
      'Content-Type': 'application/json'
    },
    body: JSON.stringify({
      service: 'url-to-markdown',
      operation: 'url_to_markdown',
      parameters: { url }
    })
  });
  return response.json();
}));

Use Cases:

AI Training Data

Convert web content to clean text for fine-tuning LLMs or building RAG systems.

Documentation Migration

Scrape legacy docs from old wikis or sites and convert to modern markdown format.

Content Aggregation

Build automated news digests by scraping and formatting articles from multiple sources.

SEO Research

Extract competitor content for analysis while maintaining clean, readable formatting.

Link Discovery & Sitemap Generation

Service: sitemap-generator

Crawl websites to discover all links, then generate valid XML sitemaps. Useful for SEO tools, site audits, and migration planning.

Audit a Website's Link Structure

Discover all internal and external links on a page for SEO analysis.

curl -X POST https://www.acrewity.com/api/services/execute \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "service": "sitemap-generator",
    "operation": "extract_links",
    "parameters": {
      "url": "https://www.example.com"
    }
  }'

Generate a Sitemap from Discovered URLs

Create a valid XML sitemap for submission to search engines.

# Python - Discover links then generate sitemap
import requests

# Step 1: Extract all links
links_response = requests.post(
    'https://www.acrewity.com/api/services/execute',
    headers={'Authorization': 'Bearer YOUR_API_KEY', 'Content-Type': 'application/json'},
    json={
        'service': 'sitemap-generator',
        'operation': 'extract_links',
        'parameters': {'url': 'https://www.mysite.com'}
    }
)
urls = links_response.json()['result']['data']['links']

# Step 2: Generate sitemap from discovered URLs
sitemap_response = requests.post(
    'https://www.acrewity.com/api/services/execute',
    headers={'Authorization': 'Bearer YOUR_API_KEY', 'Content-Type': 'application/json'},
    json={
        'service': 'sitemap-generator',
        'operation': 'generate_sitemap',
        'parameters': {'urls': urls}
    }
)
sitemap_xml = sitemap_response.json()['result']['data']['sitemap']

Use Cases:

Broken Link Detection

Extract all links from your site, then verify each one works correctly.

Site Migration Planning

Discover all URLs before migrating to ensure proper redirects are set up.

Related Services

Last updated: December 30, 2025