Greg Pomerantz
3c5bee96ce
Some dump files carry a trailing 'ctime' column: an older pipeline appended a FULL re-download of the symbol per download (up to ~28 vintages per date, 2019-2022). The consumer keeps the last row per date, so it silently used stale (~2021) vintages where Yahoo later revised values. scripts/clean_multivintage.py keeps, per date, the rows from the newest ctime (event files keep distinct same-day amounts; history/split keep the single newest row), drops the ctime column, sorts by date. Applied to the data root and overrides/frozen (which carried the same artifact): 1,065 files, 2,202,712 stale rows dropped. Also: stripped 3 UTF-8 BOMs (teg/lo/krft), refreshed the event backup with the cleaned files, and re-ran the double-listing scan: category C (83 symbols, 18,636 repeated within-file rows) is fully explained by the multi-vintage artifact and is now gone; A (6,589 pairs, corrected) and B (12,366 pairs, open review list) are unchanged. Whole-set structural QC after cleaning: 0 duplicate dates, 3 syms/15 rows of OHLC invariant violations, 15 syms/2,897 rows of non-positive prices (mostly long-delisted tickers), 8 unsorted files (reader sorts).
142 lines
2.3 KiB
Plaintext
142 lines
2.3 KiB
Plaintext
Date,Dividends
|
|
1985-07-29,0.18
|
|
1985-10-28,0.55
|
|
1986-01-28,0.56
|
|
1986-03-18,0.57
|
|
1986-07-28,0.58
|
|
1986-10-28,0.59
|
|
1987-01-27,0.6
|
|
1987-04-28,0.61
|
|
1987-07-28,0.62
|
|
1987-10-28,0.63
|
|
1988-02-01,0.64
|
|
1988-04-28,0.6528
|
|
1988-07-26,0.6652
|
|
1988-10-26,0.6776
|
|
1989-01-26,0.69
|
|
1989-04-03,0.5076
|
|
1989-04-26,0.1952
|
|
1989-07-28,0.7152
|
|
1989-10-30,0.7276
|
|
1990-01-30,0.74
|
|
1990-04-30,0.7528
|
|
1990-07-30,0.7652
|
|
1990-10-29,0.7776
|
|
1991-01-30,0.79
|
|
1991-04-29,0.8028
|
|
1991-07-30,0.8152
|
|
1991-10-28,0.8276
|
|
1992-01-21,0.84
|
|
1992-04-28,0.8552
|
|
1992-07-28,0.435
|
|
1992-10-28,0.4426
|
|
1993-01-28,0.45
|
|
1993-04-27,0.4576
|
|
1993-07-28,0.465
|
|
1993-10-28,0.4726
|
|
1994-01-28,0.48
|
|
1994-04-27,0.49
|
|
1994-04-28,0.22313
|
|
1994-07-28,0.5
|
|
1994-11-02,0.51
|
|
1995-01-17,0.52
|
|
1995-04-27,0.53
|
|
1995-08-01,0.54
|
|
1995-11-01,0.55
|
|
1996-02-01,0.56
|
|
1996-05-01,0.57
|
|
1996-07-31,0.58
|
|
1996-10-31,0.59
|
|
1997-01-30,0.6
|
|
1997-04-30,0.61
|
|
1997-07-31,0.62
|
|
1997-10-30,0.63
|
|
1998-02-05,0.64
|
|
1998-04-30,0.65
|
|
1998-07-30,0.66
|
|
1998-10-30,0.67
|
|
1999-02-01,0.68
|
|
1999-04-29,0.69
|
|
1999-07-29,0.7
|
|
1999-10-19,0.71
|
|
2000-02-01,0.72
|
|
2000-05-01,0.73
|
|
2000-08-01,0.74
|
|
2000-11-01,0.75
|
|
2001-02-01,0.76
|
|
2001-05-01,0.77
|
|
2001-08-01,0.78
|
|
2001-10-31,0.79
|
|
2002-01-31,0.8
|
|
2002-05-02,0.81
|
|
2002-08-01,0.82
|
|
2002-11-06,0.83
|
|
2003-02-04,0.83
|
|
2003-05-01,0.83
|
|
2003-07-31,0.83
|
|
2003-10-31,0.83
|
|
2004-02-02,0.835
|
|
2004-05-04,0.4175
|
|
2004-08-02,0.4175
|
|
2004-11-04,0.4175
|
|
2005-02-03,0.42
|
|
2005-05-03,0.42
|
|
2005-08-04,0.42
|
|
2005-11-03,0.42
|
|
2006-02-09,0.425
|
|
2006-05-04,0.425
|
|
2006-08-03,0.425
|
|
2006-11-01,0.425
|
|
2007-02-01,0.445
|
|
2007-05-03,0.445
|
|
2007-08-02,0.445
|
|
2007-11-01,0.445
|
|
2008-02-05,0.455
|
|
2008-05-01,0.455
|
|
2008-08-07,0.455
|
|
2008-11-06,0.455
|
|
2009-02-05,0.46
|
|
2009-05-01,0.46
|
|
2009-08-04,0.46
|
|
2009-11-05,0.46
|
|
2010-02-09,0.465
|
|
2010-04-29,0.465
|
|
2010-08-05,0.465
|
|
2010-11-04,0.465
|
|
2011-02-08,0.48
|
|
2011-05-05,0.48
|
|
2011-08-04,0.48
|
|
2011-11-03,0.48
|
|
2012-02-02,0.5
|
|
2012-05-03,0.5
|
|
2012-08-02,0.5
|
|
2012-11-01,0.5
|
|
2013-01-31,0.525
|
|
2013-05-02,0.525
|
|
2013-08-01,0.525
|
|
2013-10-31,0.525
|
|
2014-02-06,0.545
|
|
2014-05-08,0.545
|
|
2014-08-07,0.545
|
|
2014-11-06,0.545
|
|
2015-02-05,0.565
|
|
2015-05-07,0.565
|
|
2015-08-06,0.565
|
|
2015-11-05,0.565
|
|
2016-02-04,0.575
|
|
2016-05-05,0.575
|
|
2016-08-04,0.575
|
|
2016-11-08,0.37
|
|
2017-02-13,0.37
|
|
2017-05-04,0.37
|
|
2017-08-03,0.37
|
|
2017-11-03,0.37
|
|
2018-02-14,0.37
|
|
2018-05-04,0.37
|
|
2018-08-03,0.37
|
|
2018-11-02,0.37
|
|
2019-02-15,0.37
|
|
2019-05-03,0.37
|
|
2019-08-02,0.37
|
|
2019-11-01,0.37
|