Twitter API Tutorial

How to Scrape Twitter User Tweets

Get recent tweets from a Twitter/X user. This guide walks you through the entire process, with copy-paste code examples in Node.js, JavaScript, Python, PHP, Ruby, Java, C#, Go, Rust, TypeScript, Swift, Kotlin, R and cURL.

Overview

What You'll Learn

Setting up your environment
Installing the required HTTP client
Authenticating with SociaVault API
Making requests to Twitter
Handling responses and errors

What You'll Get

Access to user tweets data
JSON formatted responses
Real-time data access
Scalable solution
Error handling patterns

Prerequisites

1. API Key

First, you'll need a SociaVault API key to authenticate your requests.

Get your free API key

2. Development Environment

Make sure you have the following ready:

Your preferred language installed (Python, Node.js, etc.)
A code editor (VS Code, Sublime, etc.)
Command line interface access

Implementation

Pick your language below — the install command and full code example update accordingly.

Step 1: Install the HTTP client (Node.js)

We'll use axios to make HTTP requests in Node.js.

bash

npm install axios

Step 2: Make the request (Node.js)

Here's the full Node.js example. Replace YOUR_API_KEY with your actual API key.

nodejs

import axios from 'axios';

const API_KEY = 'YOUR_API_KEY';

async function scrape() {
  try {
    const response = await axios.get(`https://api.sociavault.com/twitter/user-tweets?handle=elonmusk`, {
      headers: {
        'x-api-key': API_KEY,
        'Content-Type': 'application/json'
      }
    });

    console.log('Response:', response.data);
    return response.data;
  } catch (error) {
    console.error('Error:', error.response?.data || error.message);
  }
}

// Usage
scrape();

Step 1: Install the HTTP client (JavaScript)

We'll use fetch to make HTTP requests in JavaScript.

bash

# Native fetch API

Step 2: Make the request (JavaScript)

Here's the full JavaScript example. Replace YOUR_API_KEY with your actual API key.

javascript

const API_KEY = 'YOUR_API_KEY';

async function scrape() {
  try {
    const response = await fetch(`https://api.sociavault.com/twitter/user-tweets?handle=elonmusk`, {
      headers: {
        'x-api-key': API_KEY,
        'Content-Type': 'application/json'
      }
    });
    
    const data = await response.json();
    console.log('Response:', data);
    return data;
  } catch (error) {
    console.error('Error:', error);
  }
}

scrape();

Step 1: Install the HTTP client (Python)

We'll use requests to make HTTP requests in Python.

bash

pip install requests

Step 2: Make the request (Python)

Here's the full Python example. Replace YOUR_API_KEY with your actual API key.

python

import requests

api_key = "YOUR_API_KEY"
url = "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk"

headers = {
    "x-api-key": api_key,
    "Content-Type": "application/json"
}

try:
    response = requests.get(url, headers=headers)
    response.raise_for_status()
    data = response.json()
    print("Response:", data)
except requests.exceptions.RequestException as e:
    print("Error:", e)

Step 1: Install the HTTP client (PHP)

We'll use curl to make HTTP requests in PHP.

bash

# PHP cURL extension required

Step 2: Make the request (PHP)

Here's the full PHP example. Replace YOUR_API_KEY with your actual API key.

php

<?php
$apiKey = "YOUR_API_KEY";
$url = "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk";

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_HTTPHEADER, [
    "x-api-key: $apiKey",
    "Content-Type: application/json"
]);

$response = curl_exec($ch);
curl_close($ch);

echo $response;
?>

Step 1: Install the HTTP client (Ruby)

We'll use net/http to make HTTP requests in Ruby.

bash

# Standard library

Step 2: Make the request (Ruby)

Here's the full Ruby example. Replace YOUR_API_KEY with your actual API key.

ruby

require 'net/http'
require 'json'

url = URI("https://api.sociavault.com/twitter/user-tweets?handle=elonmusk")
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true

request = Net::HTTP::Get.new(url)
request["x-api-key"] = "YOUR_API_KEY"
request["Content-Type"] = "application/json"

response = http.request(request)
puts response.read_body

Step 1: Install the HTTP client (Java)

We'll use HttpClient to make HTTP requests in Java.

bash

// Java 11+ Standard Library

Step 2: Make the request (Java)

Here's the full Java example. Replace YOUR_API_KEY with your actual API key.

java

import java.net.URI;
import java.net.http.HttpClient;
import java.net.http.HttpRequest;
import java.net.http.HttpResponse;

public class Scraper {
    public static void main(String[] args) throws Exception {
        String apiKey = "YOUR_API_KEY";
        String url = "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk";

        HttpClient client = HttpClient.newHttpClient();
        HttpRequest request = HttpRequest.newBuilder()
                .uri(URI.create(url))
                .header("x-api-key", apiKey)
                .header("Content-Type", "application/json")
                .GET()
                .build();

        HttpResponse<String> response = client.send(request, HttpResponse.BodyHandlers.ofString());
        System.out.println(response.body());
    }
}

Step 1: Install the HTTP client (C#)

We'll use HttpClient to make HTTP requests in C#.

bash

// .NET Standard Library

Step 2: Make the request (C#)

Here's the full C# example. Replace YOUR_API_KEY with your actual API key.

csharp

using System;
using System.Net.Http;
using System.Threading.Tasks;

class Program {
    static async Task Main() {
        using var client = new HttpClient();
        client.DefaultRequestHeaders.Add("x-api-key", "YOUR_API_KEY");
        
        var response = await client.GetAsync("https://api.sociavault.com/twitter/user-tweets?handle=elonmusk");
        var content = await response.Content.ReadAsStringAsync();
        
        Console.WriteLine(content);
    }
}

Step 1: Install the HTTP client (Go)

We'll use net/http to make HTTP requests in Go.

bash

// Standard library

Step 2: Make the request (Go)

Here's the full Go example. Replace YOUR_API_KEY with your actual API key.

package main

import (
	"fmt"
	"io/ioutil"
	"net/http"
)

func main() {
	url := "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk"
	req, _ := http.NewRequest("GET", url, nil)
	req.Header.Add("x-api-key", "YOUR_API_KEY")
	req.Header.Add("Content-Type", "application/json")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()
	body, _ := ioutil.ReadAll(res.Body)

	fmt.Println(string(body))
}

Step 1: Install the HTTP client (Rust)

We'll use reqwest to make HTTP requests in Rust.

bash

cargo add reqwest tokio

Step 2: Make the request (Rust)

Here's the full Rust example. Replace YOUR_API_KEY with your actual API key.

rust

use reqwest;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    let client = reqwest::Client::new();
    let resp = client.get("https://api.sociavault.com/twitter/user-tweets?handle=elonmusk")
        .header("x-api-key", "YOUR_API_KEY")
        .header("Content-Type", "application/json")
        .send()
        .await?
        .text()
        .await?;

    println!("{}", resp);
    Ok(())
}

Step 1: Install the HTTP client (TypeScript)

We'll use axios to make HTTP requests in TypeScript.

bash

npm install axios

Step 2: Make the request (TypeScript)

Here's the full TypeScript example. Replace YOUR_API_KEY with your actual API key.

typescript

import axios from 'axios';

const API_KEY: string = 'YOUR_API_KEY';

interface ResponseData {
  [key: string]: any;
}

async function scrape(): Promise<ResponseData | void> {
  try {
    const response = await axios.get<ResponseData>(`https://api.sociavault.com/twitter/user-tweets?handle=elonmusk`, {
      headers: {
        'x-api-key': API_KEY,
        'Content-Type': 'application/json'
      }
    });

    console.log('Response:', response.data);
    return response.data;
  } catch (error) {
    console.error('Error:', error);
  }
}

scrape();

Step 1: Install the HTTP client (Swift)

We'll use URLSession to make HTTP requests in Swift.

bash

// Standard library

Step 2: Make the request (Swift)

Here's the full Swift example. Replace YOUR_API_KEY with your actual API key.

swift

import Foundation

let url = URL(string: "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk")!
var request = URLRequest(url: url)
request.httpMethod = "GET"
request.addValue("YOUR_API_KEY", forHTTPHeaderField: "x-api-key")
request.addValue("application/json", forHTTPHeaderField: "Content-Type")

let task = URLSession.shared.dataTask(with: request) { data, response, error in
    if let data = data {
        if let json = try? JSONSerialization.jsonObject(with: data, options: []) {
            print(json)
        }
    }
}

task.resume()

Step 1: Install the HTTP client (Kotlin)

We'll use OkHttp to make HTTP requests in Kotlin.

bash

implementation("com.squareup.okhttp3:okhttp:4.10.0")

Step 2: Make the request (Kotlin)

Here's the full Kotlin example. Replace YOUR_API_KEY with your actual API key.

kotlin

import okhttp3.OkHttpClient
import okhttp3.Request

fun main() {
    val client = OkHttpClient()
    val request = Request.Builder()
        .url("https://api.sociavault.com/twitter/user-tweets?handle=elonmusk")
        .addHeader("x-api-key", "YOUR_API_KEY")
        .addHeader("Content-Type", "application/json")
        .build()

    client.newCall(request).execute().use { response ->
        println(response.body?.string())
    }
}

Step 1: Install the HTTP client (R)

We'll use httr to make HTTP requests in R.

bash

install.packages('httr')

Step 2: Make the request (R)

Here's the full R example. Replace YOUR_API_KEY with your actual API key.

library(httr)

url <- "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk"
response <- GET(url, add_headers("x-api-key" = "YOUR_API_KEY", "Content-Type" = "application/json"))

content(response, "text")

Step 1: Install the HTTP client (cURL)

We'll use curl to make HTTP requests in cURL.

bash

# No installation required on most systems

Step 2: Make the request (cURL)

Here's the full cURL example. Replace YOUR_API_KEY with your actual API key.

curl

curl -X GET "https://api.sociavault.com/twitter/user-tweets?handle=elonmusk" \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json"

Testing Your Code

API Parameters

Parameter	Type	Required	Description
handle	string	Yes	Example: `elonmusk`

Expected Response

You should receive a structured JSON response containing the user tweets data.

json

{
  "tweets": [
    {
      "__typename": "Tweet",
      "rest_id": "1828402665845322123",
      "core": {
        "user_results": {
          "result": {
            "__typename": "User",
            "id": "VXNlcjo0NTIwMjQxMjA5",
            "rest_id": "4520241209",
            "is_blue_verified": true,
            "profile_image_shape": "Circle",
            "legacy": {
              "created_at": "Fri Dec 18 02:48:59 +0000 2015",
              "default_profile": false,
              "default_profile_image": false,
              "description": "Social Media Scraping API's: https://t.co/eSvJcfOZwF\n\nWeb Scraping Course: https://t.co/aTGlgWnvD7",
              "entities": {
                "description": {
                  "urls": [
                    {
                      "display_url": "sociavault.com",
                      "expanded_url": "https://sociavault.com/",
                      "url": "https://t.co/eSvJcfOZwF",
                      "indices": [
                        29
                      ]
                    }
                  ]
                },
                "url": {
                  "urls": [
                    {
                      "display_url": "thewebscrapingguy.com",
                      "expanded_url": "https://thewebscrapingguy.com/",
                      "url": "https://t.co/gNUelkV9LA",
                      "indices": [
                        0
                      ]
                    }
                  ]
                }
              },
              "fast_followers_count": 0,
              "favourites_count": 87301,
              "followers_count": 17297,
              "friends_count": 1139,
              "has_custom_timelines": true,
              "is_translator": false,
              "listed_count": 162,
              "location": "Austin, TX",
              "media_count": 1152,
              "name": "Adrian | The Web Scraping Guy",
              "normal_followers_count": 17297,
              "pinned_tweet_ids_str": [
                "1628769691547074562"
              ],
              "possibly_sensitive": false,
              "profile_banner_url": "https://pbs.twimg.com/profile_banners/4520241209/1710267319",
              "profile_image_url_https": "https://pbs.twimg.com/profile_images/1413647704161275904/1tTdl4v9_normal.jpg",
              "profile_interstitial_type": "",
              "screen_name": "adrian_horning_",
              "statuses_count": 17751,
              "translator_type": "none",
              "url": "https://t.co/gNUelkV9LA",
              "verified": false
            },
            "professional": {
              "rest_id": "1554172330263339015",
              "professional_type": "Business"
            },
            "tipjar_settings": {
              "is_enabled": false,
              "bandcamp_handle": "",
              "bitcoin_handle": "",
              "cash_app_handle": "",
              "ethereum_handle": "",
              "gofundme_handle": "",
              "patreon_handle": "",
              "pay_pal_handle": "",
              "venmo_handle": ""
            }
          }
        }
      },
      "edit_control": {
        "edit_tweet_ids": [
          "1828402665845322123"
        ],
        "editable_until_msecs": "1724763740000",
        "is_edit_eligible": false,
        "edits_remaining": "5"
      },
      "is_translatable": false,
      "views": {
        "count": "493762",
        "state": "EnabledWithCount"
      },
      "source": "<a href=\"https://tweethunter.io\" rel=\"nofollow\">Tweet Hunter Pro</a>",
      "legacy": {
        "bookmark_count": 1030,
        "bookmarked": false,
        "created_at": "Tue Aug 27 12:02:20 +0000 2024",
        "conversation_id_str": "1828402665845322123",
        "display_text_range": [
          0
        ],
        "entities": {
          "media": [
            {
              "display_url": "pic.x.com/fh8xBzkrKI",
              "expanded_url": "https://x.com/adrian_horning_/status/1828402665845322123/photo/1",
              "id_str": "1828402662682841089",
              "indices": [
                217
              ],
              "media_key": "3_1828402662682841089",
              "media_url_https": "https://pbs.twimg.com/media/GV_KiM-W0AEa31c.png",
              "type": "photo",
              "url": "https://t.co/fh8xBzkrKI",
              "ext_media_availability": {
                "status": "Available"
              },
              "sizes": {
                "large": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "medium": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "small": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "thumb": {
                  "h": 117,
                  "w": 117,
                  "resize": "crop"
                }
              },
              "original_info": {
                "height": 117,
                "width": 182,
                "focus_rects": [
                  {
                    "x": 0,
                    "y": 0,
                    "w": 182,
                    "h": 102
                  }
                ]
              },
              "media_results": {
                "result": {
                  "media_key": "3_1828402662682841089"
                }
              }
            }
          ]
        },
        "extended_entities": {
          "media": [
            {
              "display_url": "pic.x.com/fh8xBzkrKI",
              "expanded_url": "https://x.com/adrian_horning_/status/1828402665845322123/photo/1",
              "id_str": "1828402662682841089",
              "indices": [
                217
              ],
              "media_key": "3_1828402662682841089",
              "media_url_https": "https://pbs.twimg.com/media/GV_KiM-W0AEa31c.png",
              "type": "photo",
              "url": "https://t.co/fh8xBzkrKI",
              "ext_media_availability": {
                "status": "Available"
              },
              "sizes": {
                "large": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "medium": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "small": {
                  "h": 117,
                  "w": 182,
                  "resize": "fit"
                },
                "thumb": {
                  "h": 117,
                  "w": 117,
                  "resize": "crop"
                }
              },
              "original_info": {
                "height": 117,
                "width": 182,
                "focus_rects": [
                  {
                    "x": 0,
                    "y": 0,
                    "w": 182,
                    "h": 102
                  }
                ]
              },
              "media_results": {
                "result": {
                  "media_key": "3_1828402662682841089"
                }
              }
            }
          ]
        },
        "favorite_count": 1722,
        "favorited": false,
        "full_text": "I just scraped 2.8 million companies from crunchbase 🤯\n\nName, website, semrush stats, etc.\n\nI'm giving the entire thing away in the next 24 hours\n\nComment \"crunchbase\" and I'll send it to you. Make sure DM's are open https://t.co/fh8xBzkrKI",
        "is_quote_status": false,
        "lang": "en",
        "possibly_sensitive": false,
        "possibly_sensitive_editable": true,
        "quote_count": 12,
        "reply_count": 3186,
        "retweet_count": 64,
        "retweeted": false,
        "user_id_str": "4520241209",
        "id_str": "1828402665845322123"
      },
      "quick_promote_eligibility": {
        "eligibility": "IneligibleUserUnauthorized"
      },
      "url": "https://x.com/Austen/status/1935730646267158797"
    }
  ]
}

Best Practices

Error Handling

Implement comprehensive error handling and retry logic for failed requests. Log errors properly for debugging.

Caching

Cache responses when possible to reduce API calls and improve performance. Consider data freshness requirements.

Security

Never expose your API key in client-side code. Use environment variables and secure key management practices.

Troubleshooting

401

Unauthorized

Check your API key is correct and properly formatted in the x-api-key header.

402

Payment Required

You ran out of credits and need to buy more.

404

Not Found

The resource (user, video, etc.) might not exist or be private.

429

Too Many Requests

You have exceeded your rate limit. Slow down your requests.

Frequently Asked Questions

How much does it cost to scrape Twitter?

SociaVault offers 50 free API calls to get started. After that, pricing starts at $10 for 5k requests with volume discounts available.

Is it legal to scrape Twitter data?

Scraping publicly available data is generally considered legal. We only collect public data that is accessible without logging in.

Which programming languages can I use to scrape Twitter?

Any language that can make an HTTP request. This tutorial includes ready-to-use examples in Node.js, JavaScript, Python, PHP, Ruby, Java, C#, Go, Rust, TypeScript, Swift, Kotlin, R, cURL.

What data format does the API return?

All API responses are returned in JSON format, making it easy to integrate with any programming language or application.

Start Scraping Free View Documentation

Overview

What You'll Learn

What You'll Get

Prerequisites

1. API Key

2. Development Environment

Implementation

Step 1: Install the HTTP client (Node.js)

Step 2: Make the request (Node.js)

Step 1: Install the HTTP client (JavaScript)

Step 2: Make the request (JavaScript)

Step 1: Install the HTTP client (Python)

Step 2: Make the request (Python)

Step 1: Install the HTTP client (PHP)

Step 2: Make the request (PHP)

Step 1: Install the HTTP client (Ruby)

Step 2: Make the request (Ruby)

Step 1: Install the HTTP client (Java)

Step 2: Make the request (Java)

Step 1: Install the HTTP client (C#)

Step 2: Make the request (C#)

Step 1: Install the HTTP client (Go)

Step 2: Make the request (Go)

Step 1: Install the HTTP client (Rust)

Step 2: Make the request (Rust)

Step 1: Install the HTTP client (TypeScript)

Step 2: Make the request (TypeScript)

Step 1: Install the HTTP client (Swift)

Step 2: Make the request (Swift)

Step 1: Install the HTTP client (Kotlin)

Step 2: Make the request (Kotlin)

Step 1: Install the HTTP client (R)

Step 2: Make the request (R)

Step 1: Install the HTTP client (cURL)

Step 2: Make the request (cURL)

Testing Your Code

API Parameters

Expected Response

Best Practices

Error Handling

Caching

Security

Troubleshooting

Unauthorized

Payment Required

Not Found

Too Many Requests

Frequently Asked Questions

How much does it cost to scrape Twitter?

Is it legal to scrape Twitter data?

Which programming languages can I use to scrape Twitter?

What data format does the API return?

Related Tutorials

More Twitter Tutorials

Other Platforms

Ready to Start Scraping?