f/dow-dividend.csv at 19b33d5a18a5f2c124bf1e0a7de3acea9d711f4b

gmp/f

Greg Pomerantz 3c5bee96ce Clean multi-vintage 'ctime' files: 1,065 files, 2.2M stale rows

Some dump files carry a trailing 'ctime' column: an older pipeline
appended a FULL re-download of the symbol per download (up to ~28
vintages per date, 2019-2022). The consumer keeps the last row per date,
so it silently used stale (~2021) vintages where Yahoo later revised
values. scripts/clean_multivintage.py keeps, per date, the rows from the
newest ctime (event files keep distinct same-day amounts; history/split
keep the single newest row), drops the ctime column, sorts by date.
Applied to the data root and overrides/frozen (which carried the same
artifact): 1,065 files, 2,202,712 stale rows dropped.

Also: stripped 3 UTF-8 BOMs (teg/lo/krft), refreshed the event backup
with the cleaned files, and re-ran the double-listing scan: category C
(83 symbols, 18,636 repeated within-file rows) is fully explained by the
multi-vintage artifact and is now gone; A (6,589 pairs, corrected) and
B (12,366 pairs, open review list) are unchanged. Whole-set structural
QC after cleaning: 0 duplicate dates, 3 syms/15 rows of OHLC invariant
violations, 15 syms/2,897 rows of non-positive prices (mostly
long-delisted tickers), 8 unsorted files (reader sorts).

2026-08-31 22:25:02 -04:00

3.1 KiB

Raw Blame History

1	Date	Dividends
2	1972-06-26	0.025
3	1972-09-25	0.025
4	1972-12-22	0.025
5	1973-03-26	0.025
6	1973-06-25	0.02778
7	1973-09-24	0.02778
8	1973-12-24	0.02778
9	1974-03-25	0.02778
10	1974-06-24	0.03333
11	1974-09-24	0.03333
12	1974-12-24	0.03889
13	1975-03-24	0.03889
14	1975-06-24	0.03889
15	1975-09-24	0.04444
16	1975-12-24	0.04444
17	1976-03-25	0.04444
18	1976-06-24	0.05556
19	1976-09-24	0.05556
20	1976-12-27	0.05556
21	1977-03-25	0.05556
22	1977-06-24	0.06667
23	1977-09-26	0.06667
24	1977-12-23	0.06667
25	1978-03-27	0.06667
26	1978-06-26	0.06667
27	1978-09-25	0.07778
28	1978-12-22	0.07778
29	1979-03-26	0.07778
30	1979-06-25	0.07778
31	1979-09-24	0.08889
32	1979-12-24	0.08889
33	1980-03-25	0.08889
34	1980-06-24	0.08889
35	1980-09-24	0.08889
36	1980-12-24	0.1
37	1981-03-25	0.1
38	1981-06-24	0.1
39	1981-09-24	0.1
40	1981-12-24	0.1
41	1982-03-30	0.1
42	1982-06-24	0.1
43	1982-10-04	0.1
44	1982-12-27	0.1
45	1983-03-28	0.1
46	1983-06-24	0.1
47	1983-09-26	0.1
48	1983-12-23	0.1
49	1984-03-26	0.1
50	1984-06-25	0.1
51	1984-09-24	0.1
52	1984-12-24	0.1
53	1985-03-26	0.1
54	1985-06-25	0.1
55	1985-09-24	0.1
56	1985-12-24	0.1
57	1986-03-24	0.1
58	1986-06-24	0.1
59	1986-09-24	0.11111
60	1986-12-24	0.11111
61	1987-03-25	0.11111
62	1987-06-24	0.12222
63	1987-09-24	0.12222
64	1987-12-24	0.12222
65	1988-03-25	0.13333
66	1988-06-24	0.13333
67	1988-09-26	0.15556
68	1988-12-23	0.15556
69	1989-03-27	0.17778
70	1989-06-26	0.17778
71	1989-09-25	0.21667
72	1989-12-22	0.21667
73	1990-03-26	0.21667
74	1990-06-25	0.21667
75	1990-09-24	0.21667
76	1990-12-24	0.21667
77	1991-03-22	0.21667
78	1991-06-24	0.21667
79	1991-09-24	0.21667
80	1991-12-24	0.21667
81	1992-03-25	0.21667
82	1992-06-24	0.21667
83	1992-09-24	0.21667
84	1992-12-24	0.21667
85	1993-03-25	0.21667
86	1993-06-24	0.21667
87	1993-09-24	0.21667
88	1993-12-27	0.21667
89	1994-03-25	0.21667
90	1994-06-24	0.21667
91	1994-09-26	0.21667
92	1994-12-23	0.21667
93	1995-03-27	0.21667
94	1995-06-28	0.25
95	1995-09-27	0.25
96	1995-12-27	0.25
97	1996-03-27	0.25
98	1996-06-26	0.25
99	1996-09-26	0.25
100	1996-12-27	0.25
101	1997-03-26	0.25
102	1997-06-26	0.29
103	1997-09-26	0.29
104	1997-12-29	0.29
105	1998-03-27	0.29
106	1998-06-26	0.29
107	1998-09-28	0.29
108	1998-12-29	0.29
109	1999-03-29	0.29
110	1999-06-28	0.29
111	1999-09-28	0.29
112	1999-12-29	0.29
113	2000-03-29	0.29
114	2000-06-28	0.29
115	2000-09-27	0.29
116	2000-12-27	0.29
117	2001-02-07	0.121
118	2001-03-28	0.169
119	2001-06-27	0.335
120	2001-09-26	0.335
121	2001-12-27	0.335
122	2002-03-26	0.335
123	2002-06-26	0.335
124	2002-09-26	0.335
125	2002-12-27	0.335
126	2003-03-26	0.335
127	2003-06-26	0.335
128	2003-09-26	0.335
129	2003-12-29	0.335
130	2004-03-29	0.335
131	2004-06-28	0.335
132	2004-09-28	0.335
133	2004-12-29	0.335
134	2005-03-29	0.335
135	2005-06-28	0.335
136	2005-09-28	0.335
137	2005-12-28	0.335
138	2006-03-29	0.375
139	2006-06-28	0.375
140	2006-09-27	0.375
141	2006-12-27	0.375
142	2007-03-28	0.375
143	2007-06-27	0.42
144	2007-09-26	0.42
145	2007-12-27	0.42
146	2008-03-27	0.42
147	2008-06-26	0.42
148	2008-09-26	0.42
149	2008-12-29	0.42
150	2009-03-27	0.15
151	2009-06-26	0.15
152	2009-09-28	0.15
153	2009-12-29	0.15
154	2010-03-29	0.15
155	2010-06-28	0.15
156	2010-09-28	0.15
157	2010-12-29	0.15
158	2011-03-29	0.15
159	2011-06-28	0.25
160	2011-09-28	0.25
161	2011-12-28	0.25
162	2012-03-28	0.25
163	2012-06-27	0.32
164	2012-09-26	0.32
165	2012-12-20	0.32
166	2013-03-26	0.32
167	2013-06-26	0.32
168	2013-09-26	0.32
169	2013-12-27	0.32
170	2014-03-27	0.37
171	2014-06-26	0.37
172	2014-09-26	0.37
173	2014-12-29	0.42
174	2015-03-27	0.42
175	2015-06-26	0.42
176	2015-09-28	0.42
177	2015-12-29	0.46
178	2016-03-29	0.46
179	2016-06-28	0.46
180	2016-09-28	0.46
181	2016-12-23	0.46
182	2017-03-29	0.46
183	2017-06-28	0.46
184	2017-07-27	0.46

3.1 KiB Raw Blame History

3.1 KiB

Raw Blame History