Data is a Dish That's Best Served Hot
•Download as PPTX, PDF•
1 like•558 views
The document discusses using FME to automate the process of summarizing oil and gas permit data. It outlines the steps taken which include: having a desire to analyze the data, researching how to access and work with the data, creating a workflow recipe in FME, gathering necessary data files, preparing the data for analysis through feature merging and attribute exposure, combining data based on permit numbers, styling and mapping the data for presentation, and finalizing a raster map for sharing and analysis. The overall process allows for a repeatable workflow to consistently deliver updated permit summaries.
Report
Share
More Related Content
More from Safe Software
More from Safe Software (20)
Recently uploaded
Recently uploaded (14)
Data is a Dish That's Best Served Hot
- 1. Data is a Dish Best Served HotRobert C. White, Jr.President, WhiteStar Corporation
- 2. Rule of PresentationsTake your audience to places they’ve never been before or places they cannot visit, introduce them to fascinating people, and tell them things they never would have thought possible.- Dave Baysinger- Denver Museum of Nature and Science.
- 4. RecipeWhat’s required for tasty cuisine?A desireResearchA recipeShoppingPreparingCombiningBakingPresentationDo you like?
- 5. Desire
- 6. Desire
- 7. DesireDesire to read the Texas RRC permit dataDesire to generate a .JPG Desire to automate this processRun a .FMW designed in FME WorkbenchRun in a batch file thatCalls wget to get the fileRuns the .FMWCreates a new PostgreSQL tableMoves the .JPG to the right place
- 8. Research
- 9. ResearchTravel to CanadaGet some trainingBeg for help!Beg for some more help!
- 10. Shopping
- 11. ShoppingTX RRC can set up a daily ftp for usHave a Shape file of Texas county polygons.Have a Shape file of Texas Pipelines.
- 12. Recipe
- 13. RecipeWant a repeatable workflow.Create a tabular table in PostgreSQLCreate a raster .jpg map showingWell permits highlighted in the past weekCounty namesWell API numberMap can be analyzed to reveal patterns!Want to know what wells are permitted < 5000 feet from my pipeline this week.
- 14. Preparation
- 15. PreparingText Line ReaderThe first two characters are the record numberUse a Test Filter to branch for further processing
- 16. PreparingNow for something completely different
- 17. PreparingFME Function Caller – Replace substring
- 18. PreparingNeed to expose those attributes!
- 19. Combining
- 20. CombiningRemember permit # is only in record 01Set a global variable for permitnoIt only changes when you get a new 01Add that to subsequent recordsUse FeatureMerge to combine records together based on the same permitnoThis must be done one record type at a time
- 21. Baking
- 22. BakingCookCounty boundariesBuild line and poly topologies.Create text for select featuresBuffer point featuresSet polygonFill colorsText heightsFont
- 23. Presentation
- 24. PresentationRun the RasterizerSort vectors into appropriate orderDeliver the finished .jpg for viewingLet’s look at the .FMW in detail…
- 26. FeatureMergers with a plan…
- 27. Create text and markers
- 28. Business logic
- 29. County lines to taste…
- 30. Bring it all together (Bake)
- 31. And then Tweet about it.
- 32. Final Pizza Pie!
- 33. Did you like?
- 34. RecapWhat’s required for tasty cuisine?A desire – Convert Raw FileResearch – Ask the head chefs.A recipe – The grunt workShopping - Gather Data ResourcesPreparing- Use the utensils to simplify .FMWCombining – Merge ingredients togetherBaking – A pinch of salt, food coloring to taste.Presentation – Stuff the pizza crust.Do you like? – The acid test.
- 35. Thank You!Questions?For more information:Robert C. White, Jr. – rwhite@whitestar.comThe WhiteStar Corporationhttp://www.whitestar.com