Abstract
Two components of food security monitoring are accurate forecasts of local grain prices and the ability to identify unusual price behavior. We evaluated a method that can both facilitate forecasts of cross-country grain price data and identify dissimilarities in price behavior across multiple markets. This method, characteristic based clustering (CBC), identifies similarities in multiple time series based on structural characteristics in the data. Here, we conducted a simulation experiment to determine if CBC can be used to improve the accuracy of maize price forecasts. We then compared forecast accuracies among clustered and non-clustered price series over a rolling time horizon. We found that the accuracy of forecasts on clusters of time series were equal to or worse than forecasts based on individual time series. However, in the following experiment we found that CBC was still useful for price analysis. We used the clusters to explore the similarity of price behavior among Kenyan maize markets. We found that price behavior in the isolated markets of Mandera and Marsabit has become increasingly dissimilar from markets in other Kenyan cities, and that these dissimilarities could not be explained solely by geographic distance. The structural isolation of Mandera and Marsabit that we find in this paper is supported by field studies on food security and market integration in Kenya. Our results suggest that a market with a unique price series (as measured by structural characteristics that differ from neighboring markets) may lack market integration and food security.











Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Notes
Famine Early Warning System Network http://www.fews.net/Pages/default.aspx
Auto-regressive Integrated Moving Average. See appendix B for an overview of ARIMA models
Exogenous shocks can also induce non-linearity in price data.
Meaning that the trend and seasonal components have been removed
Their approach differs by metric but generally involves statistical transformations based on similar values from white noise and known benchmark datasets. For more details see Wang et al. (2006) pg. 346.
Given n dimensions (characteristics in this case) the Euclidean distance between two points (time series) i and j can be calculated as: \( d\left(i,j\right){=}^{/}\overline{{\left({i}_1-{j}_1\right)}^2+{\left({i}_2-{j}_2\right)}^2+\dots +{\left({i}_n-{j}_n\right)}^2} \)
Within a cluster we did not aggregate data that are reported in different currencies or volumes. This means we did not aggregate across countries (only within) or across retail and wholesale markets (only within).
The main disadvantage of the MAPE is that it cannot accommodate time series where there are 0 values in the data. Our current evaluation focuses on price series with no 0 values so this is not a problem. For a scale independent measure that can accommodate 0 values, Hyndman and Koehler (2006) propose the Mean Absolute Scaled Error (MASE).
In the real data example where some series are recorded in different units, we only average series together if they are in the same unit.
This index is calculated from major maize, wheat, and rice ports around the world, and does not include sub-Saharan markets
We calculated the metric using the Box-Pierce multivariate portmanteau test (Box and Pierce 1970).
References
Ansah, I.G., Gardebroek, C., Ihle, R., Jaleta, M. (2014). Analyzing developing country market integration with incomplete price data using cluster analysis. Proceedings Issues, 2014: Food, Resources and Conflict, December 7–9, 2014, San Diego, California 197169, International Agricultural Trade Research Consortium, URL http://EconPapers.repec.org/RePEc:ags:iats14:197169
Baulch, B. (1997). Transfer costs, spatial arbitrage, and testing for food market integration. American Journal of Agricultural Economics, 79(2), 477–487.
Box, G. E., & Pierce, D. A. (1970). Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association, 65(332), 1509–1526.
Brown, M. E., & Funk, C. C. (2008). Climate: food security under climate change. Science, 319(5863), 580–581.
Brown, M. E., Tondel, F., Essam, T., Thorne, J. A., Mann, B. F., Leonard, K., Stabler, B., & Eilerts, G. (2012). Country and regional staple food price indices for improved identification of food insecurity. Global Environmental Change, 22(3), 784–794.
Burgess, R., & Donaldson, D. (2010). Can openness mitigate the effects of weather shocks? evidence from India’s famine era. American Economic Review, 100(2), 449–453.
Checchi, F., Robinson, W. (2013). Mortality among populations of southern and central somalia affected by severe food insecurity and famine during 2010–2012. Tech. rep., FAO Food Security and Nutrition Analysis Unit- Somalia, URL http://www.fsnau.org/downloads/Somalia_Mortality_Estimates_Final_Report_8May2013_upload.pdf
Colino, E. V., Irwin, S. H., & Garcia, P. (2011). Improving the accuracy of outlook price forecasts. Agricultural Economics, 42(3), 357–371.
Davenport, F., D. G. Steigerwald and S. H. Sweeney (2015). “Open Trade, Price Supports, and Regional Price Behavior in Mexican Maize Markets.” Economic Geography, In press.
DeMatteis, A. (2012). Using food aid to stimulate markets in pastoral areas: market assessment into the ec food facility programme in Northern Kenya. Tech. rep., Save the children
Elliott, H., Fowler, B. (2012). Markets and poverty in Northern Kenya: Towards a financial graduation model. Tech. rep., FSD Kenya, URL http://www.fsdkenya.org/pdf_documents/12-10-03_ Financial_Graduation_report.pdf
Fackler, P.L., Goodwin, B.K., Bruce, L.G., Rausser, G.C. (2001). Chapter 17 spatial price analysis. In: Handbook of agricultural economics, vol volume 1, part 2. Elsevier, pp 971–1024
Fafchamps, M. (1992). Cash crop production, food price volatility, and rural market integration in the third world. American Journal of Agricultural Economics, 74(1), 90–99.
FEWSNET (2012). Famine early warning system network. US Agency for International Development, URL http://www.fews.net/Pages/default.aspx
Funk, C., Husak, G., Michaelsen, J., Shukla, S., Hoell, A., Lyon, B., Hoerling, M., Liebmann, B., Zhang, T., Verdin, J., Galu, G., Eilerts, G., Rowland, J. (2013). Attribution of 2012 and 2003–12 rainfall deficits in Eastern Kenya and Southern Somalia. In: Explaining extreme events of 2012 from a climate perspective, vol 94, Bulletin of the American Meteorological Society, pp S45–S48
Gospodinov, N., & Ng, S. (2011). Commodity prices, convenience yields, and inflation. Review of Economics and Statistics, 95(1), 206–219.
Grace, K., Davenport, F., Funk, C., & Lerner, A. M. (2012). Child malnutrition and climate in sub-saharan Africa: an analysis of recent trends in Kenya. Applied Geography, 35(1), 405–413.
Hilborn, R. C., & Sprott, J. (1994). Chaos and nonlinear dynamics: An introduction for scientists and engineers. New York: Oxford University Press.
Hillbruner, C., & Moloney, G. (2012). When early warning is not enough lessons learned from the 2011 Somalia famine. Global Food Security, 1(1), 20–28. doi:10.1016/j.gfs.2012.08. 001. URL http://www.sciencedirect.com/science/article/pii/S2211912412000107.
Hillier, D., & Dempsey, B. (2012). A dangerous delay: the cost of late response to early warnings in the 2011 drought in the horn of Africa. Oxfam Policy and Practice: Agriculture, Food and Land, 12(1), 1–34.
Hyndman, R., Khandakar, Y. (2008). Automatic time series forecasting: the forecast package for r. Journal of Statistical Software 27(i03)
Hyndman, R. J., & Koehler, A. B. (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22(4), 679–688.
Hyndman, R. J., Akram, M., & Archibald, B. C. (2008). The admissible parameter space for exponential smoothing models. Annals of the Institute of Statistical Mathematics, 60(2), 407–426.
Ihle, R., von Cramon-Taubadel, S., & Zorya, S. (2009). Markov-switching estimation of spatial maize price transmission processes between Tanzania and Kenya. American Journal of Agricultural Economics, 91(5), 1432–1439.
Jayne, T. S., Myers, R. J., & Nyoro, J. (2008). The effects of NCPB marketing policies on maize market prices in Kenya. Agricultural Economics, 38(3), 313–325.
Jayne, T., Mason, N., Myers, R., Ferris, J., Mather, D., Beaver, M., Lenski, N., Chapoto, A., Boughton, D. (2010). Patterns and trends in food staples markets in Eastern and Southern Africa: Toward the identification of priority investments and strategies for developing markets and promoting smallholder productivity growth. Tech. rep.
Kedia V., Thummala, V., Karlapalem, K. (2004). Time series forecasting through clustering-a case study. Duke University Department of Computer Science
Liao, T. W. (2005). Clustering of time series data survey. Pattern Recognition, 38(11), 1857–1874.
Makridakis, S., Wheelwright, S., Hyndman, R. (1998). Forecasting: methods and applications
Mantel, N. (1967). The detection of disease clustering and a generalized regression approach. Cancer Research, 27(2 Part 1), 209–220.
Montero, P., Vilar, J.A. (2014). Tsclust: An r package for time series clustering. Journal of Statistical Software
Perakis, S. M. (2012). Changing spatial maize price relationships in West Africa. In 2012 Annual Meeting, August 12–14, 2012. Seattle: Agricultural and Applied Economics Association.
Piesse, J., & Thirtle, C. (2009). Three bubbles and a panic: an explanatory review of recent food commodity price events. Food Policy, 34(2), 119–129.
Rapsomanikis, G., Conforti, P. (2006). Market integration and price transmission in selected food and cash crop markets of developing countries: review and applications. In: Agricultural commodity markets and trade: new approaches to analyzing market structure and instability, p 187
Tan, P. (2007). Cluster analysis. In: Introduction to data mining, Pearson Education India, chap 8
Terasvirta, T., Lin, C. F., & Granger, C. W. J. (1993). Power of the neural network linearity test. Journal of Time Series Analysis, 14(2), 209–220.
Wang, Q., & Hu, Y. (2015). Cross-correlation between interest rates and commodity prices. Physica A: Statistical Mechanics and its Applications, 428, 80–89.
Wang, X., Smith, K., & Hyndman, R. (2006). Characteristic-based clustering for time series data. Data Mining and Knowledge Discovery, 13(3), 335–364.
Wang, Y., Tsay, R. S., Ledolter, J., & Shrestha, K. M. (2013). Forecasting simultaneously high-dimensional time series: a robust model-based clustering approach. Journal of Forecasting, 32(8), 673–684. doi:10.1002/for.2264.
WFP (2013). Market dynamics and financial services in Kenyas Arid Lands. Tech. rep., World Food Program
Willinger, W., Paxson, V., Taqqu, M.S. (1998). Self-similarity and heavy tails: structural modeling of network traffic. In: A practical guide to heavy tails: statistical techniques and applications, vol 23, pp 27–53
Zou, H., Xia, G., Yang, F., & Wang, H. (2007). An investigation and comparison of artificial neural network and time series models for Chinese food grain price forecasting. Neurocomputing, 70(1618), 2913–2923. doi:10.1016/j.neucom.2007.01.009.
Acknowledgments
Kathryn Grace provided many insightful comments on an earlier version of this manuscript. This work was supported by US Geological Survey (USGS) cooperative agreement (#G09AC000001), the USGS Climate and Land Use Change program, NASA SERVIR, and NASA grants NNH12ZDA001N- IDS and NNX14AD30G. The Kenyan price data was provided courtesy of Blake Stabler at FEWS NET and the Kenyan Ministry of Agriculture.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
ESM 1
(DOCX 480 kb)
Rights and permissions
About this article
Cite this article
Davenport, F., Funk, C. Using time series structural characteristics to analyze grain prices in food insecure countries. Food Sec. 7, 1055–1070 (2015). https://doi.org/10.1007/s12571-015-0490-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12571-015-0490-5