NLA Trial index

NLA Trial Articles from 1837

Notes
  1. Accuracy of OCR and overProof is measured in comparison with the human corrections. We know human corrections in this sample are incomplete, and themselves contain errors, but they are the best we could find automatically from the NLA newspapers corpus, tagged as completely corrected then further filtered to those with at least 3 corrections, at least 40% of lines corrected and lowest third percentage of non-dictionary words.
  2. Accuracy is measured by a separate process from that used to colour words in this output: the colouring process is heuristic, and not completely accurate.
  3. Colour legend:
    Text - OCR text corrected by human and/or overProof
    Text - human and/or overProof corrections
    Text - discrepencies between human and/or overProof
    Text - human corrections not applied by overProof
  4. Identified overProof corrections are calculated by the statistical calculation process, and shows those words changed by overProof which ALSO match human corrections. As human corrections are often wrong and incomplete, so too is this list.
  5. Identified overProof non-corrections are calculated by the statistical calculation process, and shows those words in the overProof output which DO NOT MATCH human corrections. As human corrections are often wrong and incomplete, so too is this list. Words marked as [**VANDALISED] are those which have been changed by overProof but not by the human correction; as before, a missed human correction will be (incorrectly) classified as vandalisation by overProof.
  6. Searchability of unique words refers to the distinct words in an article, and how many are present before and after correction. It is measure of how many of the words within an article could be used to find the article using a search engine.
  7. Weighted Words refers to a calculation in which common words count for little (a fraction of a word) and unusual words count for more, in proportion to the log of the inverse of their frequency in the corpus. It may be an indicator of how well distinctive words in an article can be searched before and after correction.

Article ID 2210845, Article, SHIPPING INTELLIGENCE. ARRIVALS., page 2 1837-05-11, The Sydney Gazette and New South Wales Advertiser (NSW : 1803 - 1842), 147 words, 7 corrections

Raw OCRHuman CorrectedoverProof Corrected
SHIfffrlttC! IKT3X.X.XÖBNCB. SHIPPING INTELLIGENCE. SHIfffrlttC! IKT3X.X.XÖBNCB.
'ARRIVALS. ARRIVALS. ARRIVALS.
From Now Zealand, on I »estlay last, whence-'slie From New Zealand, on Tuesday last, whence she From New Zealand, on I tuesday last, whence she
sailed lim 20ili ultimo, the brig Nimnul, tja plain sailed the 28th ultimo, the brig Nimrod, Captain sailed the 30th ultimo, the brig Nimrod, tea plain
Bennett wi h sumidos. I assengers, Mrs. Mitch'II Bennett with sundries. Passengers, Mrs. Mitchell Bennett with sundries. I passengers, Mrs. Mitchell
and family, wah ihiee seivants, Mr*. Oakes and and family, with three servants, Mrs. Oakes and and family, with three servants, Mrs. Oakes and
.seven cldldre.li, Mia Biillar'aml family'. Mrs. Hitch- seven children, Mrs. Butler and family, Mrs. seven children, Mrs Biillar'aml family'. Mrs. Hitch-
Hitchcock, Mr. Johnson, and Thomas Bettington. Hitchcock, Mr. Johnson, and Thomas Bettington. Hitchcock, Mr. Johnson, and Thomas Bettington.
DEPARTURES. DEPARTURES. DEPARTURES.
For Hobart Town, on Monday last, the schooner] For Hobart Town, on Monday last, the schooner For Hobart Town, on Monday last, the schooner]
Ulai inn Wa'san, Captain llayle, willi sundries. Narian Watson, Captain Hayle, with sundries. Ulai inn Watson, Captain Hayle, with sundries.
Fnr Newcastle, same evening, tlio steamer Tama' For Newcastle, same evening, the steamer Tamara. For Newcastle, same evening, the steamer Tamar'
For Moreton Bay veMenlay, iho Government For Moreton Bay yesterday, the Government For Moreton Bay yesterday, the Government
schooner hahella. Captain Hole, with stores, &e. schooner Isabella, Captain Hole, with stores, &c. schooner Isabella. Captain Boyle, with stores, c.
'For the Whale Fnhi-ry, same day, the schooner For the Whale Fishery, same day, the schooner For the Whale Fishery, same day, the schooner
Vulilht Packst, Captain Leaihait wirh stores. Dublin Packet, Captain Leathart with stores. Dublin Packet, Captain Leathart with stores.
PROJECTED DEPARTURES. PROJECTED DEPARTURES. PROJECTED DEPARTURES.
Tim John, 'the Kinnear, and Fortune for London,] The John, the Kinnear, and Fortune for London, The John, the Kinnear, and Fortune for London,]
nnd the D nmarh Hill (ox Iho Whale Fishery, this and the Denmark Hill for the Whale Fishery, this and the D marh Hill (ex The Whale Fishery, this
dav. day. day.
(C^* The Phipfi.'nalised to the Southward jestor« The Ship signalised to the Southward yester- (CO The Phipfi.'nalised to the Southward jesters
day, wns al sundown far off tho Heads, according to' terday was at sundown far off the Heads, according to day, was at sundown far off the Heads, according to
the signal from the Light-house at South Head. ' the signal from the Light-house at South Head. the signal from the Light-house at South Head. '
Identified overProof corrections NEW YESTERDAY SHE TUESDAY ISABELLA NIMROD PASSENGERS THREE PACKET MITCHELL WAS SERVANTS DUBLIN WATSON HAYLE CHILDREN LEATHART
Identified overProof non-corrections NARIAN YESTER BUTLER INTELLIGENCE TERDAY SHIP TAMARA SHIPPING SIGNALISED HOLE [**VANDALISED] DENMARK
Word
count		OCR
accuracy %		overProof
accuracy %		Errors
corrected %
All Words13865.989.970.2
Searchability of unique words8869.387.559.3
Weighted Words72.689.059.8

Article ID 31719750, Article, DEPARTURES., page 7 1837-08-24, The Colonist (Sydney, NSW : 1835 - 1840), 51 words, 5 corrections

Raw OCRHuman CorrectedoverProof Corrected
DEPARTURES.. i ': DEPARTURES. DEPARTURES.. i ':
August 17.-Argo (brig), for New Zealand, with August 17.—Argo (brig), for New Zealand, with August 17 Argo (brig), for New Zealand, with
bundries. sundries. sundries.
17.-Genii (brig), for New Zealand, with sun 17.—Genii (brig), for New Zealand, with sun- 17. Genil (brig), for New Zealand, with sundries.
dries. dries.
18.-Elizabeth (ship), for Newcastle. 18.—Elizabeth (ship), for Newcastle. 18. Elizabeth (ship), for Newcastle.
18.-Success (schooner), for Newcastle. 18.—Success (schooner), for Newcastle. 18. Success (schooner), for Newcastle.
18.-James Watt (steamer), for Moreton Bay. 18.—James Watt (steamer), for Moreton Bay. 18. James Watt (steamer), for Moreton Bay.
20.-Ulitea (schooner), for the Society Islands. 20.—Ulitea (schooner), for the Society Islands. 20 Ulitea (schooner), for the Society Islands.
:20.-Captain Fyans (Government Cutter), for 20.—Captain Fyans (Government Cutter), for 20. Captain Fyans (Government Cutter), for
Moreton Bay. . Moreton Bay. Moreton Bay. .
<-22.-Perthshire (barque), for Calcutta. 22.—Perthshire (barque), for Calcutta. <-22.-Perthshire (barque), for Calcutta.
Identified overProof corrections
Identified overProof non-corrections GENII [**VANDALISED]
Word
count		OCR
accuracy %		overProof
accuracy %		Errors
corrected %
All Words4797.997.90.0
Searchability of unique words31100.096.8-222.6
Weighted Words100.096.0-69.3

Accumulated stats for 2 articles from year 1837

Word
count		OCR
accuracy %		overProof
accuracy %		Errors
corrected %
All Words18574.091.968.9
Searchability of unique words11977.389.955.6
Weighted Words79.690.854.9