SlideShare a Scribd company logo
The BC Spatial Project –
Integrating BC’s Cadastre with
FME Server




Paul van Nieuwkuyk, CartoSmart GIS
BC Spatial Project Coordinator, ICIS
ICIS




  ICIS’ Vision   BC Spatial
BC Spatial




  ICIS’ Vision   BC Spatial
Core Challenges




   Challenges   Constraints    Solutions




    Source                    Delivery /    Integrated
   Datasets                    Sharing       Products
•  No uniform data       •  Ad hoc         •  Slow refresh
   model                    submission        cycle
•  Unknown /                habits         •  Manually
   anecdotal data        •  Modest            intensive
   quality                  operational       process
                            resources
Operational Constraints




    Challenges   Constraints   Solutions


                                              Integrated
   Source                Delivery /            Products
  Datasets                Sharing
                                           •  Automate
•  Existing            •  Minimize            integration
   models reflect         impacts to       •  Assess and report:
   business need          data providers      so that producers
•  ICIS does not          in sharing          can enhance and
   alter member           their data          users can decide
   data*
Solutions




  Challenges   Constraints   Solutions



   Use the best ETL Tool!
  •  Transparent and repeatable data processes
     •  Eliminate the manual
  •  Deploy where needed
     •  Available to a distributed community… online
  •  Sensible standards
     •  Data standards based on integration needs
     •  Common processing pattern for all datasets
“Data Integration Engine”
(DIE and Do!)




                            Integrate
                             Assess                   Statistics
                             Report
 LG
                                               Integrated
                                               Data
  GeoBC
                                        QC Metadata
          BCA
                Utilities               1.  Extract/Publish
                                        2.  Subscribe/Integrate
                                        3.  Notify/Distribute
Data Provider:
Extract & Publish
Delivering with Python


                           Publication Flavors
                             Web folder
                             FTP site

                           Python shutdown
                            script
                             Automate zip and
                              ship to ICIS

                           Scheduled Task
                             Delivery routine
ICIS: Scheduled Acquisition


  Python Startup
    Acquire FTP or
     web
    Unzip
    Archive
  Standard processes
    Load (not
     integrate)
    Capture metadata
    Log change
ICIS: Real-time reporting




                       shutdown.py
                          Calls FME service
                          Refreshes statistics
                          KML data footprints as
                           index to current
                           statistics
                          On-the-fly thematic
                           rendering
                              Color spectrum from
                               newer to older vintage
Coordinating Product Refresh


  Nightly scheduled service
    Analyzes ETL Log (populated in acquisition script)
    Determines which integrated layers to refresh
    Invokes layer refresh scripts
Layer Integration


  Changed sources are refreshed:
    DELETE / INSERT
  Localized integration QC performed
    Jurisdictional
     overlaps
    Correlation
     reports:
     LTSA
     BCA
  Stats Updated
    ETL log
    QC metadata
The Program


                Activities
                   Pilot conducted 2009
                   CRD Beta Jan – June 2010
                       All municipalities and
                        regional district
                       GeoBC
                       BC Assessment
                       Utilities

                Infrastructure
                    FME Workbench & Server
                     2009
                    ArcGIS Server 9.3 on
                     SQL Server
Thank You!


  Questions?
                           Portal   • www.bcspatial.ca

  For more information:
    paul@cartosmart.com
                                    • Project Charter
    www.bcspatial.ca      Docs     • Pilot Program Report




                           Chat     • www.bcspatial.ca/
                                      blog

More Related Content

What's hot

Census Bureau PBOCS
Census Bureau PBOCSCensus Bureau PBOCS
Census Bureau PBOCS
Tolu A Williams
 
PyData NYC 2015 Presentation
PyData NYC 2015 PresentationPyData NYC 2015 Presentation
PyData NYC 2015 Presentation
viz4biz
 
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
Senturus
 
Hydraulic Modelling with GIS Data
Hydraulic Modelling with GIS DataHydraulic Modelling with GIS Data
Hydraulic Modelling with GIS Data
Safe Software
 
4 container management
4  container management4  container management
4 container management
Len Bass
 
Project Argus-Tamas Kluber
Project Argus-Tamas KluberProject Argus-Tamas Kluber
Project Argus-Tamas Kluber
Tamas Kluber
 
DSD-NL 2019 Whats new in Delft-FEWS - Boot
DSD-NL 2019 Whats new in Delft-FEWS - BootDSD-NL 2019 Whats new in Delft-FEWS - Boot
DSD-NL 2019 Whats new in Delft-FEWS - Boot
Deltares
 
Utilizing Esri Out of the Box Tools for Field Data Verification
Utilizing Esri Out of the Box Tools for Field Data VerificationUtilizing Esri Out of the Box Tools for Field Data Verification
Utilizing Esri Out of the Box Tools for Field Data Verification
SSP Innovations
 
What’s New in Assure MIMIX 10
What’s New in Assure MIMIX 10What’s New in Assure MIMIX 10
What’s New in Assure MIMIX 10
Precisely
 
Recap of OpenStack Tokyo Summit
Recap of OpenStack Tokyo SummitRecap of OpenStack Tokyo Summit
Recap of OpenStack Tokyo Summit
djzook
 
Building Hyperscale Networks
Building Hyperscale NetworksBuilding Hyperscale Networks
Building Hyperscale Networks
Open Networking Summit
 

What's hot (11)

Census Bureau PBOCS
Census Bureau PBOCSCensus Bureau PBOCS
Census Bureau PBOCS
 
PyData NYC 2015 Presentation
PyData NYC 2015 PresentationPyData NYC 2015 Presentation
PyData NYC 2015 Presentation
 
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
Cognos Analytics Performance Tuning: Tips & Tricks to Rev Performance
 
Hydraulic Modelling with GIS Data
Hydraulic Modelling with GIS DataHydraulic Modelling with GIS Data
Hydraulic Modelling with GIS Data
 
4 container management
4  container management4  container management
4 container management
 
Project Argus-Tamas Kluber
Project Argus-Tamas KluberProject Argus-Tamas Kluber
Project Argus-Tamas Kluber
 
DSD-NL 2019 Whats new in Delft-FEWS - Boot
DSD-NL 2019 Whats new in Delft-FEWS - BootDSD-NL 2019 Whats new in Delft-FEWS - Boot
DSD-NL 2019 Whats new in Delft-FEWS - Boot
 
Utilizing Esri Out of the Box Tools for Field Data Verification
Utilizing Esri Out of the Box Tools for Field Data VerificationUtilizing Esri Out of the Box Tools for Field Data Verification
Utilizing Esri Out of the Box Tools for Field Data Verification
 
What’s New in Assure MIMIX 10
What’s New in Assure MIMIX 10What’s New in Assure MIMIX 10
What’s New in Assure MIMIX 10
 
Recap of OpenStack Tokyo Summit
Recap of OpenStack Tokyo SummitRecap of OpenStack Tokyo Summit
Recap of OpenStack Tokyo Summit
 
Building Hyperscale Networks
Building Hyperscale NetworksBuilding Hyperscale Networks
Building Hyperscale Networks
 

Viewers also liked

Mis 5
Mis 5Mis 5
Salil presentation un millennium campaign april 2010
Salil presentation un millennium campaign april 2010Salil presentation un millennium campaign april 2010
Salil presentation un millennium campaign april 2010
endpoverty2015
 
Karnevalid Itaalias
Karnevalid ItaaliasKarnevalid Itaalias
Karnevalid Itaalias
Andre Kaasik
 
Reserva De Itaúna Brascan
Reserva De  Itaúna    BrascanReserva De  Itaúna    Brascan
Reserva De Itaúna Brascan
imoveisdorio
 
CV feb16
CV feb16CV feb16
CV feb16
Peter Bird
 
Internet Mktg 101 Wedo 4 15 09 Rev
Internet Mktg 101 Wedo 4 15 09 RevInternet Mktg 101 Wedo 4 15 09 Rev
Internet Mktg 101 Wedo 4 15 09 Rev
Jay Lane Media
 
Shift 2010-diy
Shift 2010-diyShift 2010-diy
Shift 2010-diy
André Ribeirinho
 
Basic template
Basic templateBasic template
Basic template
Jon Boutelle
 
Airline Deregulation
Airline DeregulationAirline Deregulation
Airline Deregulation
Nathan DeRosa
 
spf_stalker-concept
spf_stalker-conceptspf_stalker-concept
spf_stalker-concept
Stephanie Carter
 
Preservation metadata
Preservation metadataPreservation metadata
Preservation metadata
Michael Day
 
Wade CIRAD 2010
Wade CIRAD 2010Wade CIRAD 2010
Wade CIRAD 2010
Mira Slavova
 
Work sample
Work sampleWork sample
Work sample
Missy DeFina
 
%22Diamond Bourse in Paradise%22 - IDEX
%22Diamond Bourse in Paradise%22 - IDEX%22Diamond Bourse in Paradise%22 - IDEX
%22Diamond Bourse in Paradise%22 - IDEX
Dennis Smith
 
Common Event Equipment Rental Mistakes
Common Event Equipment Rental MistakesCommon Event Equipment Rental Mistakes
Common Event Equipment Rental Mistakes
Temporary Power Solutions
 
Arts & Crafts_5th and 6th_Pablo picasso
Arts & Crafts_5th and 6th_Pablo picassoArts & Crafts_5th and 6th_Pablo picasso
Arts & Crafts_5th and 6th_Pablo picasso
TRMaria
 
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
epicresearchsgmy
 
Cachitos de infancia
Cachitos de infanciaCachitos de infancia
Cachitos de infancia
José David Villafranca Marqués
 
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
kim ming
 

Viewers also liked (19)

Mis 5
Mis 5Mis 5
Mis 5
 
Salil presentation un millennium campaign april 2010
Salil presentation un millennium campaign april 2010Salil presentation un millennium campaign april 2010
Salil presentation un millennium campaign april 2010
 
Karnevalid Itaalias
Karnevalid ItaaliasKarnevalid Itaalias
Karnevalid Itaalias
 
Reserva De Itaúna Brascan
Reserva De  Itaúna    BrascanReserva De  Itaúna    Brascan
Reserva De Itaúna Brascan
 
CV feb16
CV feb16CV feb16
CV feb16
 
Internet Mktg 101 Wedo 4 15 09 Rev
Internet Mktg 101 Wedo 4 15 09 RevInternet Mktg 101 Wedo 4 15 09 Rev
Internet Mktg 101 Wedo 4 15 09 Rev
 
Shift 2010-diy
Shift 2010-diyShift 2010-diy
Shift 2010-diy
 
Basic template
Basic templateBasic template
Basic template
 
Airline Deregulation
Airline DeregulationAirline Deregulation
Airline Deregulation
 
spf_stalker-concept
spf_stalker-conceptspf_stalker-concept
spf_stalker-concept
 
Preservation metadata
Preservation metadataPreservation metadata
Preservation metadata
 
Wade CIRAD 2010
Wade CIRAD 2010Wade CIRAD 2010
Wade CIRAD 2010
 
Work sample
Work sampleWork sample
Work sample
 
%22Diamond Bourse in Paradise%22 - IDEX
%22Diamond Bourse in Paradise%22 - IDEX%22Diamond Bourse in Paradise%22 - IDEX
%22Diamond Bourse in Paradise%22 - IDEX
 
Common Event Equipment Rental Mistakes
Common Event Equipment Rental MistakesCommon Event Equipment Rental Mistakes
Common Event Equipment Rental Mistakes
 
Arts & Crafts_5th and 6th_Pablo picasso
Arts & Crafts_5th and 6th_Pablo picassoArts & Crafts_5th and 6th_Pablo picasso
Arts & Crafts_5th and 6th_Pablo picasso
 
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
EPIC RESEARCH SINGAPORE - Daily SGX Singapore report of 12 February 2016
 
Cachitos de infancia
Cachitos de infanciaCachitos de infancia
Cachitos de infancia
 
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
정품레비트라 구입방법 카톡:DDF11 & DDF11.KR 레비트라 판매,레비트라 구입,레비트라 파는곳,레비트라 팝니다,레비트라 가격,레비트...
 

Similar to The BC Spatial Project – Integrating BC’s Cadastre with FME Server

Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates UncoveredRuslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
LinkedIn
 
Overview SQL Server 2012
Overview SQL Server 2012Overview SQL Server 2012
Overview SQL Server 2012
Juan Fabian
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
Bob Rhubart
 
Initial Kautilya Brochure Doc
Initial Kautilya Brochure DocInitial Kautilya Brochure Doc
Initial Kautilya Brochure Doc
Saket Rai
 
Pre mts Sharepoint 2010 i SQL Server 2012
Pre mts   Sharepoint 2010 i SQL Server 2012Pre mts   Sharepoint 2010 i SQL Server 2012
Pre mts Sharepoint 2010 i SQL Server 2012
Łukasz Grala
 
Migrate to share point 2013 with avepoint 2.14.13
Migrate to share point 2013 with avepoint 2.14.13Migrate to share point 2013 with avepoint 2.14.13
Migrate to share point 2013 with avepoint 2.14.13
Mary Leigh Mackie
 
Tech Talk Comp Apps851 20090930
Tech Talk Comp Apps851 20090930Tech Talk Comp Apps851 20090930
Tech Talk Comp Apps851 20090930
Michael Masterson
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs
 
21st Century Service Oriented Architecture
21st Century Service Oriented Architecture21st Century Service Oriented Architecture
21st Century Service Oriented Architecture
Bob Rhubart
 
Unpacking The New Oracle BI Apps (Now With ODI!)
Unpacking The New Oracle BI Apps (Now With ODI!)Unpacking The New Oracle BI Apps (Now With ODI!)
Unpacking The New Oracle BI Apps (Now With ODI!)
KPI Partners
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
Bob Rhubart
 
Eudat user forum-london-11march2013-biovel-v3
Eudat user forum-london-11march2013-biovel-v3Eudat user forum-london-11march2013-biovel-v3
Eudat user forum-london-11march2013-biovel-v3
Alex Hardisty
 
COGNOS ANALYTICS
COGNOS ANALYTICSCOGNOS ANALYTICS
COGNOS ANALYTICS
Lesha Bhansali
 
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan GoksuSpring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
VMware Tanzu
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
confluent
 
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at PinterestDataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
Hakka Labs
 
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at PinterestScalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
Krishna Gade
 
Puppet overview
Puppet overviewPuppet overview
Puppet overview
joshbeard
 
InduSoft and Dream Report Webinar
InduSoft and Dream Report WebinarInduSoft and Dream Report Webinar
InduSoft and Dream Report Webinar
AVEVA
 
Combinação de logs, métricas e rastreamentos para observabilidade unificada
Combinação de logs, métricas e rastreamentos para observabilidade unificadaCombinação de logs, métricas e rastreamentos para observabilidade unificada
Combinação de logs, métricas e rastreamentos para observabilidade unificada
Elasticsearch
 

Similar to The BC Spatial Project – Integrating BC’s Cadastre with FME Server (20)

Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates UncoveredRuslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
Ruslan Belkin And Sean Dawson on LinkedIn's Network Updates Uncovered
 
Overview SQL Server 2012
Overview SQL Server 2012Overview SQL Server 2012
Overview SQL Server 2012
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
 
Initial Kautilya Brochure Doc
Initial Kautilya Brochure DocInitial Kautilya Brochure Doc
Initial Kautilya Brochure Doc
 
Pre mts Sharepoint 2010 i SQL Server 2012
Pre mts   Sharepoint 2010 i SQL Server 2012Pre mts   Sharepoint 2010 i SQL Server 2012
Pre mts Sharepoint 2010 i SQL Server 2012
 
Migrate to share point 2013 with avepoint 2.14.13
Migrate to share point 2013 with avepoint 2.14.13Migrate to share point 2013 with avepoint 2.14.13
Migrate to share point 2013 with avepoint 2.14.13
 
Tech Talk Comp Apps851 20090930
Tech Talk Comp Apps851 20090930Tech Talk Comp Apps851 20090930
Tech Talk Comp Apps851 20090930
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
 
21st Century Service Oriented Architecture
21st Century Service Oriented Architecture21st Century Service Oriented Architecture
21st Century Service Oriented Architecture
 
Unpacking The New Oracle BI Apps (Now With ODI!)
Unpacking The New Oracle BI Apps (Now With ODI!)Unpacking The New Oracle BI Apps (Now With ODI!)
Unpacking The New Oracle BI Apps (Now With ODI!)
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
 
Eudat user forum-london-11march2013-biovel-v3
Eudat user forum-london-11march2013-biovel-v3Eudat user forum-london-11march2013-biovel-v3
Eudat user forum-london-11march2013-biovel-v3
 
COGNOS ANALYTICS
COGNOS ANALYTICSCOGNOS ANALYTICS
COGNOS ANALYTICS
 
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan GoksuSpring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
 
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at PinterestDataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
 
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at PinterestScalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
 
Puppet overview
Puppet overviewPuppet overview
Puppet overview
 
InduSoft and Dream Report Webinar
InduSoft and Dream Report WebinarInduSoft and Dream Report Webinar
InduSoft and Dream Report Webinar
 
Combinação de logs, métricas e rastreamentos para observabilidade unificada
Combinação de logs, métricas e rastreamentos para observabilidade unificadaCombinação de logs, métricas e rastreamentos para observabilidade unificada
Combinação de logs, métricas e rastreamentos para observabilidade unificada
 

More from Safe Software

Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
Safe Software
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
Safe Software
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
Safe Software
 
An Introduction to All Data Enterprise Integration
An Introduction to All Data Enterprise IntegrationAn Introduction to All Data Enterprise Integration
An Introduction to All Data Enterprise Integration
Safe Software
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Safe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
Safe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 

More from Safe Software (20)

Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
 
An Introduction to All Data Enterprise Integration
An Introduction to All Data Enterprise IntegrationAn Introduction to All Data Enterprise Integration
An Introduction to All Data Enterprise Integration
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 

Recently uploaded

Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
DianaGray10
 
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partesExchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
jorgelebrato
 
NVIDIA at Breakthrough Discuss for Space Exploration
NVIDIA at Breakthrough Discuss for Space ExplorationNVIDIA at Breakthrough Discuss for Space Exploration
NVIDIA at Breakthrough Discuss for Space Exploration
Alison B. Lowndes
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
ZachWylie3
 
Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
Priyanka Aash
 
Top 12 AI Technology Trends For 2024.pdf
Top 12 AI Technology Trends For 2024.pdfTop 12 AI Technology Trends For 2024.pdf
Top 12 AI Technology Trends For 2024.pdf
Marrie Morris
 
Enterprise_Mobile_Security_Forum_2013.pdf
Enterprise_Mobile_Security_Forum_2013.pdfEnterprise_Mobile_Security_Forum_2013.pdf
Enterprise_Mobile_Security_Forum_2013.pdf
Yury Chemerkin
 
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptxFIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
FIDO Alliance
 
UiPath Community Day Amsterdam: Code, Collaborate, Connect
UiPath Community Day Amsterdam: Code, Collaborate, ConnectUiPath Community Day Amsterdam: Code, Collaborate, Connect
UiPath Community Day Amsterdam: Code, Collaborate, Connect
UiPathCommunity
 
The Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - CoatueThe Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - Coatue
Razin Mustafiz
 
Finetuning GenAI For Hacking and Defending
Finetuning GenAI For Hacking and DefendingFinetuning GenAI For Hacking and Defending
Finetuning GenAI For Hacking and Defending
Priyanka Aash
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
Michael Price
 
How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...
DianaGray10
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
Bhajan Mehta
 
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI CertificationTrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc
 
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Zilliz
 
History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )
Badri_Bady
 
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptxFIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Alliance
 
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
Fwdays
 
Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
Priyanka Aash
 

Recently uploaded (20)

Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
 
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partesExchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
Exchange, Entra ID, Conectores, RAML: Todo, a la vez, en todas partes
 
NVIDIA at Breakthrough Discuss for Space Exploration
NVIDIA at Breakthrough Discuss for Space ExplorationNVIDIA at Breakthrough Discuss for Space Exploration
NVIDIA at Breakthrough Discuss for Space Exploration
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
 
Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
 
Top 12 AI Technology Trends For 2024.pdf
Top 12 AI Technology Trends For 2024.pdfTop 12 AI Technology Trends For 2024.pdf
Top 12 AI Technology Trends For 2024.pdf
 
Enterprise_Mobile_Security_Forum_2013.pdf
Enterprise_Mobile_Security_Forum_2013.pdfEnterprise_Mobile_Security_Forum_2013.pdf
Enterprise_Mobile_Security_Forum_2013.pdf
 
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptxFIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
FIDO Munich Seminar: Strong Workforce Authn Push & Pull Factors.pptx
 
UiPath Community Day Amsterdam: Code, Collaborate, Connect
UiPath Community Day Amsterdam: Code, Collaborate, ConnectUiPath Community Day Amsterdam: Code, Collaborate, Connect
UiPath Community Day Amsterdam: Code, Collaborate, Connect
 
The Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - CoatueThe Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - Coatue
 
Finetuning GenAI For Hacking and Defending
Finetuning GenAI For Hacking and DefendingFinetuning GenAI For Hacking and Defending
Finetuning GenAI For Hacking and Defending
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
 
How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
 
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI CertificationTrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
 
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
 
History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )
 
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptxFIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptx
 
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
 
Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
 

The BC Spatial Project – Integrating BC’s Cadastre with FME Server

  • 1. The BC Spatial Project – Integrating BC’s Cadastre with FME Server Paul van Nieuwkuyk, CartoSmart GIS BC Spatial Project Coordinator, ICIS
  • 2. ICIS ICIS’ Vision BC Spatial
  • 3. BC Spatial ICIS’ Vision BC Spatial
  • 4. Core Challenges Challenges Constraints Solutions Source Delivery / Integrated Datasets Sharing Products •  No uniform data •  Ad hoc •  Slow refresh model submission cycle •  Unknown / habits •  Manually anecdotal data •  Modest intensive quality operational process resources
  • 5. Operational Constraints Challenges Constraints Solutions Integrated Source Delivery / Products Datasets Sharing •  Automate •  Existing •  Minimize integration models reflect impacts to •  Assess and report: business need data providers so that producers •  ICIS does not in sharing can enhance and alter member their data users can decide data*
  • 6. Solutions Challenges Constraints Solutions Use the best ETL Tool! •  Transparent and repeatable data processes •  Eliminate the manual •  Deploy where needed •  Available to a distributed community… online •  Sensible standards •  Data standards based on integration needs •  Common processing pattern for all datasets
  • 7. “Data Integration Engine” (DIE and Do!) Integrate Assess Statistics Report LG Integrated Data GeoBC QC Metadata BCA Utilities 1.  Extract/Publish 2.  Subscribe/Integrate 3.  Notify/Distribute
  • 9. Delivering with Python   Publication Flavors   Web folder   FTP site   Python shutdown script   Automate zip and ship to ICIS   Scheduled Task   Delivery routine
  • 10. ICIS: Scheduled Acquisition   Python Startup   Acquire FTP or web   Unzip   Archive   Standard processes   Load (not integrate)   Capture metadata   Log change
  • 11. ICIS: Real-time reporting   shutdown.py   Calls FME service   Refreshes statistics   KML data footprints as index to current statistics   On-the-fly thematic rendering   Color spectrum from newer to older vintage
  • 12. Coordinating Product Refresh   Nightly scheduled service   Analyzes ETL Log (populated in acquisition script)   Determines which integrated layers to refresh   Invokes layer refresh scripts
  • 13. Layer Integration   Changed sources are refreshed:   DELETE / INSERT   Localized integration QC performed   Jurisdictional overlaps   Correlation reports: LTSA BCA   Stats Updated   ETL log   QC metadata
  • 14. The Program   Activities   Pilot conducted 2009   CRD Beta Jan – June 2010   All municipalities and regional district   GeoBC   BC Assessment   Utilities   Infrastructure   FME Workbench & Server 2009   ArcGIS Server 9.3 on SQL Server
  • 15. Thank You!   Questions? Portal • www.bcspatial.ca   For more information:   paul@cartosmart.com • Project Charter   www.bcspatial.ca Docs • Pilot Program Report Chat • www.bcspatial.ca/ blog