NLA Trial Article Index - v2 run Apr 2021 using larger charmap in Phase 0 and Phase last (SimpleSuggester)

Year	Articles	All words				Unique words				Weighted words
Year	Articles	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	OCR accuracy %	overProof accuracy %	Errors corrected %
1803	4	609	73.7	90.6	64.4	402	70.9	90.0	65.8	69.6	90.1	67.5
1804	3	383	60.0	77.3	43.2	287	55.1	72.8	39.4	54.7	72.9	40.3
1805	2	416	70.7	88.2	59.8	289	67.5	86.5	58.5	69.0	87.2	58.7
1809	1	206	89.3	96.1	63.6	146	91.1	95.2	46.1	92.0	95.9	48.8
1817	2	208	77.4	87.0	42.5	162	76.5	86.5	42.3	77.0	87.1	43.9
1818	4	403	86.3	96.3	72.7	293	89.4	95.9	61.1	90.2	94.4	43.0
1819	1	239	91.2	97.5	71.6	120	92.5	98.3	77.3	94.6	98.8	77.8
1823	1	116	94.0	96.6	43.3	81	92.6	96.3	50.0	93.6	96.8	50.0
1824	1	83	51.8	75.9	50.0	66	47.0	72.7	48.5	52.0	75.3	48.5
1826	2	457	85.8	93.0	50.7	259	84.6	91.5	44.7	89.0	93.9	44.6
1827	1	231	81.8	89.6	42.9	122	81.1	90.2	48.1	84.6	92.3	50.0
1829	1	221	95.0	98.6	72.0	164	96.3	98.8	67.6	96.8	98.9	65.6
1831	1	142	88.0	97.2	76.7	91	92.3	96.7	57.1	93.1	96.7	52.2
1835	1	65	90.8	100.0	100.0	49	91.8	100.0	100.0	92.8	100.0	100.0
1837	2	185	74.0	91.9	68.9	119	77.3	89.9	55.6	79.6	90.8	54.9
1838	4	748	85.3	96.4	75.4	428	86.2	95.6	68.0	87.9	96.0	66.9
1839	5	1173	87.3	96.2	70.1	598	87.5	95.8	66.7	90.1	96.8	67.4
1840	2	182	90.7	96.7	64.3	99	90.9	93.9	33.2	91.3	93.9	29.6
1841	1	154	95.5	98.7	71.1	93	94.6	98.9	79.6	95.7	99.1	79.1
1842	4	358	86.9	95.8	68.0	229	88.7	96.0	65.0	87.7	95.1	59.9
1843	6	583	87.3	94.5	56.9	384	87.2	94.3	55.1	87.3	94.0	52.7
1844	5	357	66.4	88.5	65.9	221	69.2	88.2	61.8	67.8	87.9	62.5
1845	4	630	82.7	91.6	51.4	409	85.6	90.0	30.4	86.3	90.7	32.4
1846	4	538	87.8	95.5	63.6	300	86.3	94.0	56.2	88.2	94.7	55.3
1847	3	176	89.8	95.5	55.6	120	89.2	95.0	53.7	90.4	95.7	54.6
1848	4	1289	89.0	96.8	70.7	648	91.7	96.5	57.6	93.4	97.1	56.2
1849	3	494	94.8	98.0	61.5	306	94.8	97.4	49.3	95.3	97.7	51.1
1850	4	335	92.2	96.4	53.9	228	93.4	95.6	32.8	93.0	95.9	41.6
1851	4	626	79.4	94.7	74.5	363	84.9	94.8	65.5	87.0	95.4	65.1
1852	5	591	72.4	90.4	65.0	356	70.3	87.9	59.4	73.0	88.9	59.0
1853	5	577	66.5	91.3	74.0	342	69.0	92.1	74.5	68.9	91.9	73.9
1854	6	1669	86.8	95.0	62.3	930	87.6	95.7	65.2	88.4	96.0	65.8
1855	4	285	70.2	89.5	64.7	172	75.6	89.0	54.8	74.3	87.8	52.8
1856	6	1747	87.5	98.0	84.0	903	90.5	98.0	79.1	91.6	98.2	78.4
1857	8	1754	87.6	95.1	60.6	927	88.2	94.7	55.0	90.1	95.3	52.6
1858	8	1635	82.0	95.7	75.9	862	85.1	94.9	65.7	86.7	95.2	64.3
1859	6	742	91.9	98.9	86.8	455	93.4	98.9	83.0	93.9	98.6	77.7
1860	20	2628	82.1	93.6	64.1	1635	82.5	93.6	63.2	83.3	93.8	63.0
1861	18	3043	77.7	94.3	74.5	1867	79.7	94.2	71.3	80.0	94.4	71.8
1862	8	1280	88.4	94.8	54.7	698	89.3	94.7	50.7	90.8	95.4	50.1
Year	Articles	All words				Unique words				Weighted words
Year	Articles	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	OCR accuracy %	overProof accuracy %	Errors corrected %
1863	11	2255	73.2	92.9	73.5	1291	74.6	92.2	69.3	75.8	92.5	69.0
1864	15	1661	82.8	95.2	72.0	967	85.0	96.6	77.3	86.2	96.7	76.3
1865	7	823	76.9	92.6	67.8	488	79.7	92.8	64.6	79.1	92.5	64.1
1866	10	1337	79.8	93.7	68.8	856	81.4	93.2	63.7	82.5	93.5	62.8
1867	11	2679	86.1	96.4	74.2	1472	88.1	95.7	64.1	89.5	96.1	62.6
1868	14	1637	86.4	96.5	74.5	1041	88.8	97.4	76.8	89.8	97.6	76.0
1869	11	2459	86.7	97.6	82.1	1311	87.7	97.0	75.9	89.5	97.3	74.3
1870	7	2349	78.3	93.0	67.6	1169	83.6	94.2	64.7	84.4	94.5	64.8
1871	13	3062	81.1	94.7	71.9	1683	83.7	93.6	60.5	83.7	93.5	60.5
1872	18	5960	83.6	96.6	79.3	3066	86.5	95.9	69.7	86.9	96.0	69.7
1873	15	4839	84.6	96.1	74.8	2469	86.3	95.2	64.9	87.3	95.3	62.7
1874	8	701	80.9	90.7	51.5	492	81.9	90.3	46.1	83.0	90.9	46.5
1875	15	3669	82.6	94.8	70.2	1986	85.3	94.7	63.6	86.2	94.8	62.5
1876	13	1838	77.4	91.9	64.4	1058	80.1	92.4	61.7	81.5	93.1	62.9
1877	14	3369	85.9	95.7	69.3	1820	86.6	95.4	65.4	87.7	95.3	61.9
1878	14	4471	82.8	94.3	66.9	2138	85.0	94.0	60.1	87.0	94.3	55.9
1879	17	2042	81.9	95.1	72.8	1426	81.4	94.5	70.2	81.4	94.2	69.0
1880	21	3446	81.2	95.4	75.4	2019	85.0	96.0	73.5	85.5	95.9	71.7
1881	17	2799	78.8	95.1	77.2	1610	82.7	94.6	68.7	83.8	94.9	68.6
1882	20	4483	82.0	94.5	69.3	2400	83.3	94.3	65.8	84.3	94.6	65.5
1883	28	3517	81.6	95.1	73.3	2347	84.1	94.8	67.6	84.4	94.9	67.5
1884	28	4382	79.5	94.6	73.4	2554	82.6	94.4	67.8	83.5	94.2	65.1
1885	25	3747	79.1	94.4	73.1	2231	81.1	94.1	68.8	82.2	93.9	66.0
1886	17	2796	82.6	94.9	70.6	1633	84.6	94.7	65.3	86.3	95.1	64.1
1887	48	9173	81.6	95.6	76.2	5220	84.4	95.3	69.6	85.1	95.2	67.5
1888	48	7865	85.8	95.7	69.4	4751	86.8	95.5	65.6	87.0	95.3	64.1
1889	56	13775	85.2	95.7	70.5	7265	87.1	95.4	64.5	87.7	95.3	62.0
1890	36	8266	83.8	95.2	70.2	4359	86.8	95.4	64.8	87.2	95.2	62.4
1891	42	5363	77.5	94.9	77.6	3366	79.3	94.7	74.4	79.4	94.6	73.9
1892	33	5971	83.2	95.6	74.0	3162	85.0	94.8	65.1	86.9	95.2	63.3
1893	24	3194	84.5	96.1	74.6	1979	87.4	96.9	75.7	87.5	96.9	74.8
1894	38	5380	82.8	95.7	74.8	3316	84.5	95.9	73.4	84.4	95.7	72.6
1895	47	7057	82.7	95.9	76.6	4234	84.0	95.5	72.0	84.3	95.6	71.7
1896	53	7612	77.4	93.7	72.3	4673	79.1	93.4	68.6	79.2	93.3	67.6
1897	51	7766	84.7	94.3	62.7	4444	84.6	93.5	57.8	86.1	93.8	55.7
1898	52	7068	78.7	93.5	69.3	4359	80.6	92.8	63.0	80.8	92.6	61.3
1899	56	8290	80.1	94.2	70.6	4962	81.6	93.9	67.0	82.3	94.0	66.4
1900	97	11625	78.3	94.0	72.4	7291	80.8	94.3	70.1	79.9	93.6	67.9
1901	140	21583	78.7	94.6	74.8	12319	81.4	94.6	70.8	81.3	94.2	69.3
1902	115	17517	79.7	94.9	74.7	10080	82.1	94.7	70.3	82.2	94.3	67.9
Year	Articles	All words				Unique words				Weighted words
Year	Articles	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	OCR accuracy %	overProof accuracy %	Errors corrected %
1903	75	9861	82.2	95.1	72.6	6203	83.7	95.0	69.4	83.9	94.8	67.8
1904	57	7805	79.6	94.4	72.7	4851	82.4	94.2	67.0	83.1	94.0	64.4
1905	48	5326	82.4	94.0	65.7	3355	83.5	93.4	59.7	84.4	93.6	59.2
1906	67	7819	72.9	89.4	60.9	5000	75.8	89.1	54.8	75.3	88.2	52.1
1907	54	6831	78.2	93.6	70.5	4334	80.8	93.5	66.4	80.9	93.5	65.7
1908	93	15416	83.6	95.1	70.2	8902	85.4	95.2	66.9	86.1	95.0	63.8
1909	95	16472	83.8	95.2	70.0	9284	84.9	94.5	63.5	85.7	94.4	61.0
1910	145	20695	82.6	94.9	70.6	12428	83.7	94.7	67.7	84.2	94.5	65.2
1911	124	17367	81.3	93.7	66.3	10229	82.4	93.2	61.5	82.9	93.0	59.2
1912	82	12185	83.0	94.7	69.0	7145	85.0	94.4	62.9	85.3	94.3	61.6
1913	114	18154	82.9	94.5	67.9	10594	85.1	94.4	62.2	85.5	94.1	59.2
1914	146	22666	81.6	94.4	69.7	13234	83.3	93.9	63.6	83.7	93.5	60.0
1915	214	34165	78.1	93.3	69.3	20011	80.2	93.1	65.2	79.6	92.5	63.2
1916	114	16474	81.7	94.3	69.0	9789	83.1	94.1	64.8	83.3	93.7	62.3
1917	83	10949	78.6	93.1	67.7	6892	80.0	92.9	64.3	80.0	92.7	63.3
1918	81	11049	77.6	91.7	63.0	6800	79.5	92.0	61.1	79.5	91.7	59.8
1919	72	13095	80.3	93.8	68.6	7431	81.2	93.2	63.6	81.8	93.0	61.7
1920	127	22593	82.8	94.9	70.4	12800	84.5	94.8	66.2	84.7	94.3	62.9
1921	92	13069	82.6	94.7	69.8	7767	84.6	94.3	63.4	84.5	94.1	61.8
1922	114	15999	82.0	94.6	69.7	9822	83.6	94.4	65.9	83.3	94.0	64.2
1923	99	15163	84.1	95.0	68.8	8708	85.7	94.9	64.2	86.1	94.5	60.4
1924	125	20396	76.9	92.8	68.7	11528	78.4	91.9	62.3	78.9	91.6	60.2
1925	98	14978	75.9	92.3	68.1	8802	79.4	92.9	65.3	79.5	92.5	63.4
1926	159	27056	76.4	93.1	70.9	15228	78.6	92.9	66.6	78.9	92.5	64.6
1927	105	15648	81.3	94.6	71.2	9145	82.9	94.2	66.2	83.0	94.0	64.9
1928	98	12640	85.7	95.7	69.9	7820	86.6	95.5	66.9	86.9	95.5	65.5
1929	97	12645	82.8	94.5	67.7	7805	84.5	94.5	64.7	85.0	94.2	61.2
1930	66	6973	77.2	91.1	61.1	4505	79.2	91.2	57.8	79.5	91.0	56.0
1931	44	6188	86.0	95.7	69.4	3791	86.7	95.6	67.0	87.6	95.6	64.6
1932	61	7119	82.5	95.3	73.3	4459	84.0	95.3	70.6	83.5	95.1	70.5
1933	56	5777	79.6	93.8	69.5	3756	81.6	93.8	66.2	81.7	93.6	64.9
1934	54	8137	85.8	95.7	69.5	4695	87.5	95.7	65.7	88.3	95.9	65.1
1935	58	6898	87.0	95.7	66.9	4323	87.5	95.3	62.4	88.0	95.3	60.9
1936	64	9541	88.8	96.1	65.2	5699	89.9	96.1	61.0	90.3	96.0	58.2
1937	42	6421	87.5	96.1	68.7	3770	88.1	95.9	65.2	88.8	95.8	62.5
1938	73	11429	85.9	95.6	68.8	6854	86.7	95.4	65.5	86.6	95.0	63.0
1939	65	9959	85.0	95.8	72.3	5935	86.6	95.8	68.7	86.0	95.4	67.4
1940	30	3454	84.4	95.3	69.6	2244	86.7	95.5	66.2	86.9	95.4	65.1
1941	39	4350	87.7	96.8	74.0	2822	89.2	96.8	70.5	89.2	96.7	69.2
1942	27	4259	86.1	95.2	65.7	2412	88.3	95.8	63.8	89.5	96.0	61.8
Year	Articles	All words				Unique words				Weighted words
Year	Articles	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	Word count	OCR accuracy %	overProof accuracy %	Errors corrected %	OCR accuracy %	overProof accuracy %	Errors corrected %
1943	29	4079	88.5	96.3	68.1	2561	88.4	95.8	63.9	88.6	95.6	61.4
1944	32	4254	84.5	94.0	61.3	2712	86.6	94.5	59.3	86.5	94.3	57.7
1945	50	6160	89.4	96.6	67.7	3968	90.1	96.3	63.1	90.3	96.3	61.6
1946	46	6092	87.6	96.3	69.9	3711	89.1	96.2	65.2	89.4	96.2	64.3
1947	33	3713	89.6	95.5	56.9	2369	90.2	95.1	50.1	91.4	95.5	47.8
1948	29	2743	87.0	95.2	63.2	1867	88.5	95.7	62.3	88.4	95.4	60.1
1949	20	2304	90.9	96.4	60.4	1497	91.5	96.1	53.6	91.3	95.8	51.8
1950	30	4221	91.6	96.6	60.1	2426	91.9	96.1	52.0	92.6	96.7	54.9
1951	27	3339	89.6	96.4	65.5	2099	91.1	96.7	62.8	91.4	96.5	59.3
1952	29	4539	89.2	96.3	65.9	2678	90.3	96.5	63.5	91.2	96.8	63.0
1953	43	5559	90.0	95.5	55.2	3453	90.6	95.2	48.9	91.4	95.3	45.4
1954	35	3598	88.9	94.0	45.7	2414	89.4	94.4	46.6	90.0	94.4	44.0
1955	2	337	86.4	95.9	69.7	199	90.9	98.0	77.8	92.3	98.3	77.6
1956	2	126	80.2	91.2	55.8	99	80.8	89.9	47.6	82.9	90.9	46.9
1957	2	391	93.9	97.4	57.6	231	94.8	97.8	58.4	95.9	98.1	53.3
1958	2	338	89.1	96.7	70.2	223	90.6	98.2	81.3	91.5	98.3	80.5
1960	1	153	99.3	100.0	100.0	90	100.0	100.0	NaN	100.0	100.0	NaN
1961	1	118	91.5	95.8	50.6	71	94.4	94.4	.0	95.6	95.6	.0
1962	1	108	90.7	96.3	60.2	67	89.6	94.0	42.3	91.3	95.0	42.5
1964	2	157	83.5	90.5	42.4	105	82.9	92.4	55.4	83.0	91.2	48.5
1966	1	55	94.5	98.2	67.3	42	95.2	97.6	50.0	95.8	97.9	50.0
1968	1	258	95.7	97.3	37.2	145	95.2	97.9	56.3	96.3	98.4	56.8
1980	1	90	92.2	96.7	57.7	56	94.6	96.4	33.3	95.8	97.2	33.3
1981	1	64	93.8	96.9	50.0	47	93.6	97.9	67.2	94.5	98.2	67.3
1983	1	417	98.3	100.0	100.0	227	97.8	100.0	100.0	98.3	100.0	100.0
1989	1	73	97.3	97.3	.0	51	96.1	98.0	48.7	96.8	98.4	50.0
1992	1	64	100.0	93.8	-∞	53	100.0	92.5	-∞	100.0	93.0	-∞
TOTAL all years	5359	805755	82.0	94.5	69.7	476163	83.8	94.3	65.1	84.1	94.2	63.3