Question: I am checking coverage stats for a specific OpenFunds field in Data Explorer, but the stats differ from actual values I see in a file in OpenFunds format. Why we have this discrepancy?
Answer: Data Explorer does not perform full transformation to OpenFunds format. Coverage stats are only approximate.
Dataglide stores data in fields as specified in Kneip's Data Catalogue not in OpenFunds fields.
When Dataglide generates a file we apply transformation from Kneip's Data Catalogue to OpenFunds model. For many fields the transformation is trivial (one to one mapping), but for some fields the transformation is a bit more complex.
For example for "OFST010720 Is Passive Fund" the transformation is:
$out.OFST010720 = $row.SubFund.mkt_is_passive | coalesce (string.empty(sf.mkt_investproran) ? '' : (sf.mkt_investproran == 'PASSIVE' ? 'Yes' : 'No'))
As you can see the value depends on two fields mkt_is_passive and mkt_investproran.
Data Explorer does not perform any transformation. It merely display stats for a field linked to a particular OpenFunds ID in Data Catalogue. In the example above it will display coverage of the mkt_is_passive field and ignores the logic around mkt_investproran field.