Differences

This shows you the differences between two versions of the page.

--- the_capri_data_base [2021/12/14 13:07] – [Annex: Testing procedure and checking intermediate steps in COCO (biofuels)] himics
+++ the_capri_data_base [2021/12/14 14:09] – [Annex: Code lists for the COCO database] himics
@@ Line 1145: / Line 1145: @@
 | MACH | Transport equipment and machinery |
 | GFCO | Other gross fixed capital formation |
+**Table: Codes used for storing the original REGIO tables in the data base and their description (columns)**
+^ Codes used in CAPRI REGIO tables ^ Original REGIO description ^
+| LEVL | Herd size / Area / # of persons |
+| LSUN | Live stock units |
+| PROP | Physical production |
+| YILD | Yield |
+| VALE | EAA position in ECU |
+| VALN | EAA position in NC |
+**Table: Connection between CAPRI and REGIO crop areas, crop production and herd sizes**
+^ SPEL-code ^ REGIO-code ^ REGIO-code ^ REGIO-code ^ REGIO-code ^ Description of SPEL activity ^
+| SWHE | WHEA | CERE | ARAB | | Soft wheat |
+| DWHE | WHEA | CERE | ARAB | | Durum wheat |
+| RYE | | CERE | ARAB | | Rye |
+| BARL | BARL | CERE | ARAB | | Barley |
+| OATS | | CERE | ARAB | | Oats |
+| MAIZ | MAIZ | CERE | ARAB | | Maize |
+| OCER | | CERE | ARAB | | Other cereals (excl. rice) |
+| PARI | RICE | CERE | ARAB | | Paddy rice |
+| PULS | | | ARAB | | Pulses |
+| POTA | POTA | | ARAB | | Potatoes |
+| SUGB | SUGA | | ARAB | | Sugar beet |
+| RAPE | RAPE | OILS | ARAB | | Rape and turnip rape |
+| SUNF | SUNF | OILS | ARAB | | Sunflower seed |
+| SOYA | | OILS | ARAB | | Soya beans |
+| OLIV | | OLIV | PERM | | Olives for oil |
+| OOIL | | OILS | ARAB | | Other oil seeds and oleaginous fruits |
+| FLAX | | | ARAB | | Flax and hemp \*\*\* (faser) \*\*\* |
+| TOBA | TOBA | | ARAB | | Tobacco, unmanufactured, incl. dried |
+| OIND | | | ARAB | | Other industrial crops |
+| CAUL | | | ARAB | | Cauliflowers |
+| TOMA | | | ARAB | | Tomatoes |
+| OVEG | | | ARAB | | Other vegetables |
+| APPL | | | PERM | | Apples, pears and peaches |
+| OFRU | | | PERM | | Other fresh fruits |
+| CITR | | | PERM | | Citrus fruits |
+| TAGR | | VINE | PERM | | Table grapes |
+| TABO | | OLIV | PERM | | Table olives |
+| TWIN | | VINE | PERM | | Table wine |
+| OWIN | | VINE | PERM | | Other wine |
+| NURS | | | PERM | | Nursery plants |
+| FLOW | | | ARAB | | Flowers,ornamental plants, etc. |
+| OCRO | | | ARAB | | Other final crop products |
+| MILK | DCOW | | | | Dairy cows |
+| BEEF | BUL2 | BUL3 | | | Bulls fattening |
+| CALF | CALF | | | | Calves fattening (old VEAL) |
+| PORK | PIG3 | PIG2 | PIG1 | | Pig fattening |
+| MUTM | GOAT | SHEP | | | Ewes and goats |
+| MUTT | GOAT | SHEP | | | Sheep and goat fattening |
+| EGGS | POUL | | | | Laying hens |
+| POUL | POUL | | | | Poultry fattening |
+| OANI | | | | | Other animals |
+| OROO | | | ARAB | | Other root crops |
+| GRAS | GRAS | | | | Green fodder |
+| SILA | GREF | | ARAB | | Silage |
+| CALV | CALV | | | | Suckler cows |
+| RCAL | CABM | CABF | | | Calves, raising |
+| HEIF | H2SL | H2BR | H3SL | H3BR | Heifers |
+| PIGL | SOW2 | | | | Pig breeding |
+| FALL | | | FALL | | Fallow land |
+**Tables: Codes of the input allocation estimation**
+^FADN inputs (FI) ^Label  ^
+| TOIN | total inputs |
+| COSA | animal specific inputs |
+| FEDG | self grown feedings |
+| ANIO | other animal inputs |
+| FEDP | purchased feedings |
+| COSC | crop specific inputs |
+| SEED | seeds |
+| PLAP | plant protection |
+| FERT | fertilisers |
+| TOIX | other inputs (overheads) |
+^CAPRI inputs (CI) used in the reconciliation ^label ^
+| TOIN | total inputs |
+| FEED | feedings |
+| IPHA | other animal inputs |
+| COSC | crop specific inputs |
+| SEED | seeds |
+| PLAP | plant protection |
+| FERT | fertilisers |
+| REPA | repairs |
+| ENER | energy |
+| SERI | agricultural services input |
+| INPO | other inputs |
+. The set of //Other// activities that had been omitted from the econometric estimation:
+  * OTHER={OCER, OFRU, OVEG, OCRO, OWIN, OIND, OOIL, OFAR, OANI}
+. The set of activity groups, and their elements, used in the replacement or missing/negative coefficients
+  * GROUPS = {YOUNG, VEGE, SETT, PULS, PIG, OILS, MILK, MEAT, INDS, HORSE, GOAT, FRU, FOD, FLOWER, DENNY, COW, CHICK1, CHICK2, CHICK3, CERE, ARAB}
+  * YOUNG={YBUL, YCOW},
+  * VEGE={TOMA},
+  * SETT={SETA, NONF, FALL, GRAS},
+  * PULS=PULS
+  * PIG={PIGF, SOWS},
+  * OILS={RAPE, SOYA, SUNF, PARI, OLIV},
+  * INDS={TOBA, TEXT, TABO},
+  * GOAT={SHGM, SHGF},
+  * FRU={APPL, CITR, TAGR, TWIN},
+  * FOD={ROOF, MAIF},
+  * FLOWER={FLOW, NURS},
+  * DENNY={PORK, SOWS},
+  * COW={DCOW, SCOW, HEIF, HEIR, CAMF, CAFF, BULF, CAMR, CAFR},
+  * CHICK1={HENS, POUF},
+  * CERE={SWHE, DWHE, BARL, OATS, RYEM, MAIZ},
+  * ARAB={POTA, SUGB}
+. The sets of Northern European, Southern European countries:
+  * NEUR={NL000, UK000, AT000, BL000, DE000, DK000, FI000, FR000, SE000}
+  * SEUR={El000, ES000, PT000, IT000, IR000}
 ====Annex: Detailed description of Eurostat data processing in COCO (coco1_eurostat.gms)====
@@ Line 1276: / Line 1399: @@
 ====Annex: Testing procedure and checking intermediate steps in COCO (dairy)====
-The following three examples show how to use the intermediate reporting files to trace the data preparation steps. Screenshots demonstrate the arrangement of the reporting parameters by using the CAPRI Graphical User Interface.
+The following three examples show how to use the intermediate reporting files to trace the data preparation steps. Screenshots demonstrate the arrangement of the reporting parameters by using the CAPRI Graphical User Interface. COCO automatically produces the reporting files in the folder // results/coco/res_estima/ //
+**Example 1: Production of cow (COMI) and sheep (SGMI) milk**
+In order to document the procedure of data consolidation and rebooking, we look at the reporting file for France “chk_estima_FR000.gdx”.
+{{:wiki:coco_dairy_1.png?nolink|}}
+The codes in the rows show the activity code, the product code and its status. For activity codes see Annex 1: Code list.
+Status codes:
+  * INI:	initial value
+  * COCO1:	estimation value
+The initialization of the production of COMI and SGMI is done in the module //coco1_milk.gms// (see section 3.1.3). Additional remarks to better understand the example:
+  * COMI: Milk from cows (CMLK) and buffaloes (BMLK) is added up.
+  * SGMI: Milk from ewes (EMLK) and goats (GMLK) is added up.
+  * If data on cow or sheep and goat milk is not available separately, but total milk production (RMLK) is available, then production of COMI is set equal to total milk production.
+  * Only COMI and SGMI are included in the estimation in //coco1_estima.gms//
+  * The production of RMLK and its components CMLK, BMLK, EMLK and GMLK are only copied from raw data tables into this check parameter for documentation purposes.
+** Example 2: data consolidation for cow milk**
+The procedure of data consolidation and rebooking of all activities for the CAPRI product “COMI” (cow milk) is shown in the following screenshot (only part of the reporting parameter p_estimAnimMS is shown, but the full scope of the table is visible in the GUI).
+{{:wiki:coco_dairy_2.png?nolink|}}
+The codes in the rows show the activity code and its status. For activity codes see Annex 1: Code list.
+Additional codes for status include the following.
+^Status code   ^Status code description  ^
+|StdeData	|Final (small) Stde (standard deviation) attached to priors from raw data |
+|StdeScale	|Final (large) Stde attached to priors from trends but not from raw data  |
+|Upplim		|Soft upper limits triggering extra penalties if violated                 |
+|Lowlim		|Soft lower limits triggering extra penalties if violated                 |
+|Supps		|Prior value = support: comes from raw data or trends plus HP filter      |
+|Err2rev	|Original error term from preest: to steer speed of bound opening         |
+Under activity dairy cows (DCOW) the following items are reported: yield, total production (GROF), feed use (FEDM) and losses on market (LOSM). Eurostat’s //National Accounts of Agriculture (EAA)// only supply data for the aggregate milk (MILK). The equation //e_EAAMLK// in the consolidation model //AnimNSSQ// ensures the consistency of EAA values for MILK, as they are split up between cow milk (COMI) and sheep and goat milk (SGMI).
+<code gams>
+e_EAAMLK("%MS%000",T)
+     $ (p_NobsP("%MS%000","EAAP","MILK") AND ESTR("MILK") and
+        (p_NobsP("%MS%000","EAAP","COMI") or p_NobsP("%MS%000","EAAP","SGMI"))) ..
+*
+        v_EstimY("%MS%000","EAAP","MILK",T) =E=
+                             v_EstimY("%MS%000","EAAP","COMI",T) $ p_NobsP("%MS%000","EAAP","COMI")
+                           + v_EstimY("%MS%000","EAAP","SGMI",T) $ p_NobsP("%MS%000","EAAP","SGMI") ;
+</code>
+Finally. the producer prices (UVAP) are calculated directly from the monetary EEA values and production.
+The following picture shows the data processing steps (states) for the EAA values for milk.
+{{:wiki:coco_dairy_3.png?nolink|}}
+From the example for COMI above you can also understand the influence of the standard deviation from raw data (e.g. FEDM.StdeData), and standard deviation from trends (e.g. FEDM.StdeScale) Standard deviations are calculated both for raw data and the trends. For years where FEDM.StdeData is given, the results are very close to the prior values FEDM.Supps, whereas they are deviating sizeably for years where only FEDM.StdeScale is available.
+The first initialisation of //StdeData// and //StdeScale// is done in module coco1_preest.gms, which is a pre-step for the data consolidation models (crops, animals, market balances), using a Hodrick-Prescott filter to smooth the combination of given values and trend line. Both standard deviations enter the objective function (see chapter 3.1.4).
+**Example 3: data consolidation for cow dairy cow activity (DCOW)**
+The procedure of data consolidation and booking intermediate data processing results for the dairy cow activity (DCOW) is demonstrated in the following screenshot.
+{{:wiki:coco_dairy_4.png?nolink|}}
+The rows of the table show the product item code for the production activity DCOW, and the data processing steps (status). The first two lines show the coco1 results for slaughtering. The items starting with Y and I stand for the output and input of calves. The initialization, the estimation steps and the final results are all documented on the reporting parameter //p_estimAnimMS//. Items COMI and BEEF show the yields for cow milk and beef. Item DAYS is the process length, initialized by 365 days (equals one year). Finally, the item HERD models the herd size of dairy cows.
 ===== The Regionalised Data Base (CAPREG) =====
 ==== Data requirements and sources at the regional level ====