How we conduct credible research
Credibility is earned through transparency. This document explains how SociaVault Labs conducts research, our standards for statistical validity, and how we ensure our findings can be trusted.
We publish our methodology, sample sizes, and limitations with every report. You can see exactly how we reached our conclusions.
Our research is designed so others can replicate our studies using the same methods and data sources.
We report what the data shows, even when findings don't favor our business interests. Credibility comes from honesty.
We only analyze publicly available data, respect privacy, and never identify individuals without consent.
Every study follows a rigorous 6-step process designed to ensure validity, reproducibility, and transparency.
Every study starts with a specific, measurable question. 'What is the average engagement rate by follower tier?' not 'What's happening on TikTok?'
We define our population, sampling method, variables, and time period before collecting any data.
Data is collected from the SociaVault API with rigorous logging, error handling, and quality checks throughout.
Raw data is cleaned, validated, and documented. We never silently drop records or hide data quality issues.
Statistical analysis follows pre-defined plans. We use appropriate tests and always report confidence intervals.
Reports include methodology, limitations, and conflict of interest disclosures. Conclusions are supported by data.
Minimum requirements for publishable research
| Metric | Minimum | Ideal |
|---|---|---|
| Platform benchmark | 10,000+ | 50,000+ |
| Cross-platform comparison | 5,000 per platform | 20,000+ |
| Niche analysis | 1,000 per niche | 5,000+ |
| Segment reporting | 100 per segment | 500+ |
| Metric | Minimum | Ideal |
|---|---|---|
| Confidence level | 95% | 95-99% |
| Data freshness | 90 days | 30 days |
| Platform coverage | Same time period | Identical criteria |
How we calculate key metrics across all studies
Used for profile-level engagement analysis. Measures how actively an audience interacts relative to total followers.
Used for video content analysis. Measures engagement relative to actual reach rather than follower count.
Measures content reach relative to audience size. A view rate above 100% indicates algorithmic distribution beyond followers.
Measures net audience growth over a specified period. Useful for identifying suspicious growth patterns.
SociaVault Labs is the research division of SociaVault, a social media data API company. We acknowledge that findings demonstrating the value of social media data could indirectly benefit our business.
We commit to publishing findings regardless of whether they favor our business interests. Our credibility depends on objectivity, and we will never suppress unfavorable results.
We use careful language to avoid overstating conclusions
| We Don't Say | We Say Instead |
|---|---|
| "proves that" | "suggests that" |
| "always" | "typically" or "in most cases" |
| "all accounts" | "accounts in our sample" |
| "the engagement rate is" | "the average engagement rate was" |
| "this means" | "this may indicate" |
| "significant" (without context) | "statistically significant (p<0.05)" |
If we discover an error in a published report, we will:
We welcome scrutiny of our research methods. If you have questions or feedback, please reach out.