Table 8 Transcription validation issues.

From: Transcribing historical Canadian weather data

Data type

Validation issue

Solution

flag

Float number (pressure, temperature, precipitation, percentage) Precipitation, temperature

Space instead of decimal point

Replace with single decimal

 

Comma instead of decimal point

Replace with single decimal

 

Two decimal points

Replace with single decimal

 

 + or space before value if in original document

Remove extraneous character

 

Double negative

Remove second negative

 

fraction

Convert to decimal

 

Vapour pressure

Missing decimal

Multiply by 100

multiply by 100

All fields

Multiple entries in fields

Separate entries

 

Precipitation

Multiple entries in precipitation fields

Sum entries

Two values added

Wind, cloud

Multiple entries

Split entries

 

Precipitation

“Trace”, “slight” or “in” [inappreciable] in precipitation field

Replace with 0.005 (inches)

trace

Cloud

Cloud amount “Hidden”,” Fog”,”Haze”,”Mist” or “Smoke”

Cloud amount = 9