Finding Free Data on the World’s Largest Companies
Summary
The document discusses ways to obtain a spreadsheet of large companies ranked by market capitalization, with company names, countries, and comparable market values or weights. The suggestions include using holdings from a global equity ETF to approximate a ranked list, querying a brokerage API for market-cap data, converting published PDF tables, and downloading company rankings from a market-data website.
The ETF approach is presented as a convenient source when relative weights matter more than exact market-cap figures. The alternatives may require a ticker universe, manual page-by-page downloads, or data conversion. The responses are practical suggestions rather than a tested comparison: coverage, free access, data freshness, and consistency of market-cap definitions are not established. The source also cautions that some data sources may emphasize US-listed securities or have limited coverage of non-US firms, and it does not establish that ETF holdings exactly reproduce the global top 500 by free-float capitalization.
Key ideas
- Global ETF holdings can provide a convenient approximation of large-company rankings and weights.
- Brokerage APIs may offer market-cap data for a supplied list of tickers.
- PDF-to-spreadsheet conversion can be difficult when the source table is poorly formatted.
- Some readily available company datasets may have limited non-US coverage.
- The suggested sources are not compared for accuracy, freshness, or consistency.
Tags
Full text
# Top 500 Companies in the World – Data
# Top 500 Companies in the World – Data
At the basis of an algorithm, I need an Excel/CSV file containing the world's top 500 companies (with respect to market cap, preferably free-float if possible) by Name, Country, Market-Cap (in USD, or weight points, just something consistent). Do you know where I can get this data for free?
I was able to find relevant resources here and here. The problem with the first resource is mostly the format, I tried to use tabula (python library) in order to convert the pdf into a table, but the results were not satisfying. The problem with the second is that it only contains companies listed as ADRs in the US.
## Answer by Helin (score 1)
https://quant.stackexchange.com/a/73923
Assuming market-cap weights are all that matters (but not the exact market cap values), the easiest (free) way is probably to get the data from ETF holdings. ACWI is the ETF tracking MSCI All Country World Index. Here's some sample code to get the top 500 holdings:
```
data = pd.read_csv("https://www.ishares.com/us/products/239600/ishares-msci-acwi-etf/1467271812596.ajax?fileType=csv&fileName=ACWI_holdings&dataType=fund", skiprows=9)
df = data[['Ticker', 'Name', 'Market Value', 'Weight (%)']].dropna().iloc[:500]
```
## Answer by Aditya Diwakar (score 0)
https://quant.stackexchange.com/a/60231
If you have a list of tickers that you are interested in (which can be collected very easily), then you can use the TDAmeritrade API to collect this data. Although, non-US company data may be limited. Market cap is available for almost all companies from my experience, though.
## Answer by Mark K (score 0)
https://quant.stackexchange.com/a/60800
From PDF to Excel, you may want to try AnyBizSoft's PDF Converter.
With Python and InvestPY, you can retrieve stock info like Total Revenue, Gross Profit, Operating Income, Net Income etc.
https://investpy.readthedocs.io/_api/stocks.html
## Answer by DataDaddy (score 0)
https://quant.stackexchange.com/a/60807
Try signing up for Alpaca Markets and using their API; they have a table with the entire universe of securities. The table also includes Market Cap; and its free. Other than that I believe using a Robinhood API and access one of their pre-built lists.
## Answer by Farid (score 0)
https://quant.stackexchange.com/a/73564
Companies ranked by Market Cap gives you the desired list, I did not find a better solution:
https://companiesmarketcap.com/
You can download the data as CSV and open in Excel. You have to move to the next 100, though, to get the 500.Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.