fix formatting
This commit is contained in:
Andrew Ridgway
parent
40f425eb68
commit
e7794379fb
@ -45,8 +45,9 @@ development and applying it in a strategic context.
|
||||
- Containerised and Cloud Driven Data Architecture
|
||||
|
||||
# EXPERIENCE
|
||||
## Cloud Data Architect, Redeye Apps
|
||||
_May 2022 - Present_
|
||||
## Cloud Data Architect
|
||||
### _Redeye Apps_
|
||||
#### _May 2022 - Present_
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
@ -56,8 +57,10 @@ _May 2022 - Present_
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)
|
||||
## Data Engineer, TechConnect IT Solutions
|
||||
_August 2021 – May 2022_
|
||||
|
||||
## Data Engineer,
|
||||
### _TechConnect IT Solutions_
|
||||
#### _August 2021 – May 2022_
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
@ -65,16 +68,19 @@ _August 2021 – May 2022_
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)
|
||||
## Enterprise Data Warehouse Developer, Auto and General Insurance
|
||||
_August 2019 - August 2021_
|
||||
|
||||
## Enterprise Data Warehouse Developer
|
||||
### _Auto and General Insurance_
|
||||
#### _August 2019 - August 2021_
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements
|
||||
|
||||
## Business Analyst, Auto and General Insurance
|
||||
_January 2018 - August 2019_
|
||||
## Business Analyst
|
||||
### _Auto and General Insurance_
|
||||
#### _January 2018 - August 2019_
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
@ -83,8 +89,9 @@ _January 2018 - August 2019_
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.
|
||||
|
||||
## Forecasting and Capacity Analyst, Auto and General Insurance
|
||||
_January 2017 – January 2018_
|
||||
## Forecasting and Capacity Analyst
|
||||
### _Auto and General Insurance_
|
||||
#### _January 2017 – January 2018_
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
@ -93,14 +100,16 @@ _January 2017 – January 2018_
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave
|
||||
|
||||
## Senior HR Performance Analyst, Queensland Department of Justice and Attorney General
|
||||
_June 2016 - January 2017_
|
||||
## Senior HR Performance Analyst
|
||||
### _Queensland Department of Justice and Attorney General_
|
||||
#### _June 2016 - January 2017_
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives
|
||||
|
||||
## Workforce Business Analyst, Queensland Department of Justice and Attorney General
|
||||
_July 2015 – June 2016_
|
||||
## Workforce Business Analyst
|
||||
### _Queensland Department of Justice and Attorney General_
|
||||
#### _July 2015 – June 2016_
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
@ -113,7 +122,10 @@ _July 2015 – June 2016_
|
||||
|
||||
# REFERENCES
|
||||
- Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
|
||||
_0428 038 031_
|
||||
|
||||
- Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
|
||||
_0422 012 17_
|
||||
|
||||
|
||||
@ -49,63 +49,84 @@ development and applying it in a strategic context.</p>
|
||||
<li>Containerised and Cloud Driven Data Architecture</li>
|
||||
</ul>
|
||||
<h1>EXPERIENCE</h1>
|
||||
<h2>Cloud Data Architect, Redeye Apps</h2>
|
||||
<p><em>May 2022 - Present</em>
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
- Design of Data Governance Process (Datahub driven)
|
||||
- Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)
|
||||
- CI/CD design and deployment of modelling and orchestration using Gitlab
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</p>
|
||||
<h2>Data Engineer, TechConnect IT Solutions</h2>
|
||||
<p><em>August 2021 – May 2022</em>
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
- Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)</p>
|
||||
<h2>Enterprise Data Warehouse Developer, Auto and General Insurance</h2>
|
||||
<p><em>August 2019 - August 2021</em>
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements</p>
|
||||
<h2>Business Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2018 - August 2019</em>
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
- Technologies used include VBA, PowerShell, SQL, Web API’s, SAS
|
||||
- Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</p>
|
||||
<h2>Forecasting and Capacity Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2017 – January 2018</em>
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
- Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation
|
||||
- Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</p>
|
||||
<h2>Senior HR Performance Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>June 2016 - January 2017</em>
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Workforce Business Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>July 2015 – June 2016</em>
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
- Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Cloud Data Architect</h2>
|
||||
<h3><em>Redeye Apps</em></h3>
|
||||
<h4><em>May 2022 - Present</em></h4>
|
||||
<ul>
|
||||
<li>Greenfields Research, Design and Deployment of S3 datalake (Parquet)</li>
|
||||
<li>AWS DMS, S3, Athena, Glue</li>
|
||||
<li>Research Design and Deployment of Catalog (Datahub)</li>
|
||||
<li>Design of Data Governance Process (Datahub driven)</li>
|
||||
<li>Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)</li>
|
||||
<li>CI/CD design and deployment of modelling and orchestration using Gitlab</li>
|
||||
<li>Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy</li>
|
||||
<li>Design of ETL/Pipelines (DBT)</li>
|
||||
<li>Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</li>
|
||||
</ul>
|
||||
<h2>Data Engineer,</h2>
|
||||
<h3><em>TechConnect IT Solutions</em></h3>
|
||||
<h4><em>August 2021 – May 2022</em></h4>
|
||||
<ul>
|
||||
<li>Design of Cloud Data Batch ETL solutions using Python (Glue)</li>
|
||||
<li>Design of Cloud Data Streaming ETL solution using Python (Kinesis)</li>
|
||||
<li>Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs</li>
|
||||
<li>Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)</li>
|
||||
<li>Apply Prebuilt ML models to software solutions (Sagemaker)</li>
|
||||
<li>Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)</li>
|
||||
<li>API testing and development (gRPC, Rest)</li>
|
||||
</ul>
|
||||
<h2>Enterprise Data Warehouse Developer</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>August 2019 - August 2021</em></h4>
|
||||
<ul>
|
||||
<li>ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL</li>
|
||||
<li>Bringing new data to the business to analyse for new insights</li>
|
||||
<li>Redeveloped Version Control and brought git to the data team</li>
|
||||
<li>Introduced python for API enablement in the Enterprise Data Warehouse</li>
|
||||
<li>Partnering with the business to focus data project on actual need and translating into technical requirements</li>
|
||||
</ul>
|
||||
<h2>Business Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2018 - August 2019</em></h4>
|
||||
<ul>
|
||||
<li>Automate Service Performance Reporting using PowerShell/VBA/SAS</li>
|
||||
<li>Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting</li>
|
||||
<li>Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends</li>
|
||||
<li>Technologies used include VBA, PowerShell, SQL, Web API’s, SAS</li>
|
||||
<li>Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel</li>
|
||||
<li>Gather Requirements to build meaningful reporting solutions</li>
|
||||
<li>Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</li>
|
||||
</ul>
|
||||
<h2>Forecasting and Capacity Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2017 – January 2018</em></h4>
|
||||
<ul>
|
||||
<li>Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers</li>
|
||||
<li>This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.</li>
|
||||
<li>Forecast inbound workload requirements for the Auto and General sales call center using time series analysis</li>
|
||||
<li>Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation</li>
|
||||
<li>Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy</li>
|
||||
<li>Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders</li>
|
||||
<li>Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</li>
|
||||
</ul>
|
||||
<h2>Senior HR Performance Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>June 2016 - January 2017</em></h4>
|
||||
<ul>
|
||||
<li>Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h2>Workforce Business Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>July 2015 – June 2016</em></h4>
|
||||
<ul>
|
||||
<li>Develop and refine current workforce analysis techniques and databases</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit</li>
|
||||
<li>Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h1>EDUCATION</h1>
|
||||
<ul>
|
||||
<li>2011 Bachelor of Business Management, University of Queensland</li>
|
||||
@ -113,11 +134,13 @@ development and applying it in a strategic context.</p>
|
||||
</ul>
|
||||
<h1>REFERENCES</h1>
|
||||
<ul>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
<em>0428 038 031</em></li>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
<em>0422 012 17</em></li>
|
||||
</ul></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health</li>
|
||||
</ul>
|
||||
<p><em>0428 038 031</em></p>
|
||||
<ul>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect</li>
|
||||
</ul>
|
||||
<p><em>0422 012 17</em></p></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<p>However, for this to work we need some form of conatinerised reporting application.... lucky for us there is <a href="https://www.metabase.com/">Metabase</a> which is a fantastic little reporting application that has an open core. So this got me thinking... Can I put these two applications together and create a Reporting Layer with report embedding capabilities that is deployable in the cluster and has a admin UI accesible over a web page all whilst keeping the data locked to our network?</p>
|
||||
<h3>The Beginnings of an Idea</h3>
|
||||
<p>Ok so... Big first question. Can Duckdb and Metabase talk? Well... not quite. But first lets take a quick look at the architecture we'll be employing here </p>
|
||||
|
||||
@ -49,63 +49,84 @@ development and applying it in a strategic context.</p>
|
||||
<li>Containerised and Cloud Driven Data Architecture</li>
|
||||
</ul>
|
||||
<h1>EXPERIENCE</h1>
|
||||
<h2>Cloud Data Architect, Redeye Apps</h2>
|
||||
<p><em>May 2022 - Present</em>
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
- Design of Data Governance Process (Datahub driven)
|
||||
- Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)
|
||||
- CI/CD design and deployment of modelling and orchestration using Gitlab
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</p>
|
||||
<h2>Data Engineer, TechConnect IT Solutions</h2>
|
||||
<p><em>August 2021 – May 2022</em>
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
- Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)</p>
|
||||
<h2>Enterprise Data Warehouse Developer, Auto and General Insurance</h2>
|
||||
<p><em>August 2019 - August 2021</em>
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements</p>
|
||||
<h2>Business Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2018 - August 2019</em>
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
- Technologies used include VBA, PowerShell, SQL, Web API’s, SAS
|
||||
- Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</p>
|
||||
<h2>Forecasting and Capacity Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2017 – January 2018</em>
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
- Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation
|
||||
- Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</p>
|
||||
<h2>Senior HR Performance Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>June 2016 - January 2017</em>
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Workforce Business Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>July 2015 – June 2016</em>
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
- Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Cloud Data Architect</h2>
|
||||
<h3><em>Redeye Apps</em></h3>
|
||||
<h4><em>May 2022 - Present</em></h4>
|
||||
<ul>
|
||||
<li>Greenfields Research, Design and Deployment of S3 datalake (Parquet)</li>
|
||||
<li>AWS DMS, S3, Athena, Glue</li>
|
||||
<li>Research Design and Deployment of Catalog (Datahub)</li>
|
||||
<li>Design of Data Governance Process (Datahub driven)</li>
|
||||
<li>Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)</li>
|
||||
<li>CI/CD design and deployment of modelling and orchestration using Gitlab</li>
|
||||
<li>Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy</li>
|
||||
<li>Design of ETL/Pipelines (DBT)</li>
|
||||
<li>Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</li>
|
||||
</ul>
|
||||
<h2>Data Engineer,</h2>
|
||||
<h3><em>TechConnect IT Solutions</em></h3>
|
||||
<h4><em>August 2021 – May 2022</em></h4>
|
||||
<ul>
|
||||
<li>Design of Cloud Data Batch ETL solutions using Python (Glue)</li>
|
||||
<li>Design of Cloud Data Streaming ETL solution using Python (Kinesis)</li>
|
||||
<li>Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs</li>
|
||||
<li>Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)</li>
|
||||
<li>Apply Prebuilt ML models to software solutions (Sagemaker)</li>
|
||||
<li>Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)</li>
|
||||
<li>API testing and development (gRPC, Rest)</li>
|
||||
</ul>
|
||||
<h2>Enterprise Data Warehouse Developer</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>August 2019 - August 2021</em></h4>
|
||||
<ul>
|
||||
<li>ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL</li>
|
||||
<li>Bringing new data to the business to analyse for new insights</li>
|
||||
<li>Redeveloped Version Control and brought git to the data team</li>
|
||||
<li>Introduced python for API enablement in the Enterprise Data Warehouse</li>
|
||||
<li>Partnering with the business to focus data project on actual need and translating into technical requirements</li>
|
||||
</ul>
|
||||
<h2>Business Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2018 - August 2019</em></h4>
|
||||
<ul>
|
||||
<li>Automate Service Performance Reporting using PowerShell/VBA/SAS</li>
|
||||
<li>Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting</li>
|
||||
<li>Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends</li>
|
||||
<li>Technologies used include VBA, PowerShell, SQL, Web API’s, SAS</li>
|
||||
<li>Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel</li>
|
||||
<li>Gather Requirements to build meaningful reporting solutions</li>
|
||||
<li>Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</li>
|
||||
</ul>
|
||||
<h2>Forecasting and Capacity Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2017 – January 2018</em></h4>
|
||||
<ul>
|
||||
<li>Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers</li>
|
||||
<li>This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.</li>
|
||||
<li>Forecast inbound workload requirements for the Auto and General sales call center using time series analysis</li>
|
||||
<li>Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation</li>
|
||||
<li>Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy</li>
|
||||
<li>Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders</li>
|
||||
<li>Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</li>
|
||||
</ul>
|
||||
<h2>Senior HR Performance Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>June 2016 - January 2017</em></h4>
|
||||
<ul>
|
||||
<li>Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h2>Workforce Business Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>July 2015 – June 2016</em></h4>
|
||||
<ul>
|
||||
<li>Develop and refine current workforce analysis techniques and databases</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit</li>
|
||||
<li>Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h1>EDUCATION</h1>
|
||||
<ul>
|
||||
<li>2011 Bachelor of Business Management, University of Queensland</li>
|
||||
@ -113,11 +134,13 @@ development and applying it in a strategic context.</p>
|
||||
</ul>
|
||||
<h1>REFERENCES</h1>
|
||||
<ul>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
<em>0428 038 031</em></li>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
<em>0422 012 17</em></li>
|
||||
</ul></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health</li>
|
||||
</ul>
|
||||
<p><em>0428 038 031</em></p>
|
||||
<ul>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect</li>
|
||||
</ul>
|
||||
<p><em>0422 012 17</em></p></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<p>However, for this to work we need some form of conatinerised reporting application.... lucky for us there is <a href="https://www.metabase.com/">Metabase</a> which is a fantastic little reporting application that has an open core. So this got me thinking... Can I put these two applications together and create a Reporting Layer with report embedding capabilities that is deployable in the cluster and has a admin UI accesible over a web page all whilst keeping the data locked to our network?</p>
|
||||
<h3>The Beginnings of an Idea</h3>
|
||||
<p>Ok so... Big first question. Can Duckdb and Metabase talk? Well... not quite. But first lets take a quick look at the architecture we'll be employing here </p>
|
||||
|
||||
@ -49,63 +49,84 @@ development and applying it in a strategic context.</p>
|
||||
<li>Containerised and Cloud Driven Data Architecture</li>
|
||||
</ul>
|
||||
<h1>EXPERIENCE</h1>
|
||||
<h2>Cloud Data Architect, Redeye Apps</h2>
|
||||
<p><em>May 2022 - Present</em>
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
- Design of Data Governance Process (Datahub driven)
|
||||
- Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)
|
||||
- CI/CD design and deployment of modelling and orchestration using Gitlab
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</p>
|
||||
<h2>Data Engineer, TechConnect IT Solutions</h2>
|
||||
<p><em>August 2021 – May 2022</em>
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
- Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)</p>
|
||||
<h2>Enterprise Data Warehouse Developer, Auto and General Insurance</h2>
|
||||
<p><em>August 2019 - August 2021</em>
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements</p>
|
||||
<h2>Business Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2018 - August 2019</em>
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
- Technologies used include VBA, PowerShell, SQL, Web API’s, SAS
|
||||
- Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</p>
|
||||
<h2>Forecasting and Capacity Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2017 – January 2018</em>
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
- Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation
|
||||
- Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</p>
|
||||
<h2>Senior HR Performance Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>June 2016 - January 2017</em>
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Workforce Business Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>July 2015 – June 2016</em>
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
- Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Cloud Data Architect</h2>
|
||||
<h3><em>Redeye Apps</em></h3>
|
||||
<h4><em>May 2022 - Present</em></h4>
|
||||
<ul>
|
||||
<li>Greenfields Research, Design and Deployment of S3 datalake (Parquet)</li>
|
||||
<li>AWS DMS, S3, Athena, Glue</li>
|
||||
<li>Research Design and Deployment of Catalog (Datahub)</li>
|
||||
<li>Design of Data Governance Process (Datahub driven)</li>
|
||||
<li>Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)</li>
|
||||
<li>CI/CD design and deployment of modelling and orchestration using Gitlab</li>
|
||||
<li>Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy</li>
|
||||
<li>Design of ETL/Pipelines (DBT)</li>
|
||||
<li>Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</li>
|
||||
</ul>
|
||||
<h2>Data Engineer,</h2>
|
||||
<h3><em>TechConnect IT Solutions</em></h3>
|
||||
<h4><em>August 2021 – May 2022</em></h4>
|
||||
<ul>
|
||||
<li>Design of Cloud Data Batch ETL solutions using Python (Glue)</li>
|
||||
<li>Design of Cloud Data Streaming ETL solution using Python (Kinesis)</li>
|
||||
<li>Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs</li>
|
||||
<li>Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)</li>
|
||||
<li>Apply Prebuilt ML models to software solutions (Sagemaker)</li>
|
||||
<li>Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)</li>
|
||||
<li>API testing and development (gRPC, Rest)</li>
|
||||
</ul>
|
||||
<h2>Enterprise Data Warehouse Developer</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>August 2019 - August 2021</em></h4>
|
||||
<ul>
|
||||
<li>ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL</li>
|
||||
<li>Bringing new data to the business to analyse for new insights</li>
|
||||
<li>Redeveloped Version Control and brought git to the data team</li>
|
||||
<li>Introduced python for API enablement in the Enterprise Data Warehouse</li>
|
||||
<li>Partnering with the business to focus data project on actual need and translating into technical requirements</li>
|
||||
</ul>
|
||||
<h2>Business Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2018 - August 2019</em></h4>
|
||||
<ul>
|
||||
<li>Automate Service Performance Reporting using PowerShell/VBA/SAS</li>
|
||||
<li>Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting</li>
|
||||
<li>Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends</li>
|
||||
<li>Technologies used include VBA, PowerShell, SQL, Web API’s, SAS</li>
|
||||
<li>Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel</li>
|
||||
<li>Gather Requirements to build meaningful reporting solutions</li>
|
||||
<li>Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</li>
|
||||
</ul>
|
||||
<h2>Forecasting and Capacity Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2017 – January 2018</em></h4>
|
||||
<ul>
|
||||
<li>Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers</li>
|
||||
<li>This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.</li>
|
||||
<li>Forecast inbound workload requirements for the Auto and General sales call center using time series analysis</li>
|
||||
<li>Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation</li>
|
||||
<li>Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy</li>
|
||||
<li>Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders</li>
|
||||
<li>Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</li>
|
||||
</ul>
|
||||
<h2>Senior HR Performance Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>June 2016 - January 2017</em></h4>
|
||||
<ul>
|
||||
<li>Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h2>Workforce Business Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>July 2015 – June 2016</em></h4>
|
||||
<ul>
|
||||
<li>Develop and refine current workforce analysis techniques and databases</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit</li>
|
||||
<li>Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h1>EDUCATION</h1>
|
||||
<ul>
|
||||
<li>2011 Bachelor of Business Management, University of Queensland</li>
|
||||
@ -113,11 +134,13 @@ development and applying it in a strategic context.</p>
|
||||
</ul>
|
||||
<h1>REFERENCES</h1>
|
||||
<ul>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
<em>0428 038 031</em></li>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
<em>0422 012 17</em></li>
|
||||
</ul></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health</li>
|
||||
</ul>
|
||||
<p><em>0428 038 031</em></p>
|
||||
<ul>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect</li>
|
||||
</ul>
|
||||
<p><em>0422 012 17</em></p></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry><entry><title>Metabase and DuckDB</title><link href="http://localhost:8000/metabase-duckdb.html" rel="alternate"></link><published>2023-11-15T20:00:00+10:00</published><updated>2023-11-15T20:00:00+10:00</updated><author><name>Andrew Ridgway</name></author><id>tag:localhost,2023-11-15:/metabase-duckdb.html</id><summary type="html"><p>Using Metabase and DuckDB to create an embedded Reporting Container bringing the data as close to the report as possible</p></summary><content type="html"><p>Ahhhh <a href="https://duckdb.org/">DuckDB</a> if you're even partly floating around in the data space you've probably been hearing ALOT about it and it's <em>"Datawarehouse on your laptop"</em> mantra. However, the OTHER application that sometimes gets missed is <em>"SQLite for OLAP workloads"</em> and it was this concept that once I grasped it gave me a very interesting idea.... What if we could take the very pretty Aggregate Layer of our Data(warehouse/LakeHouse/Lake) and put that data right next to presentation layer of the lake, reducing network latency and... hopefully... have presentation reports running over very large workloads in the blink of an eye. It might even be fast enough that it could be deployed and embedded </p>
|
||||
<p>However, for this to work we need some form of conatinerised reporting application.... lucky for us there is <a href="https://www.metabase.com/">Metabase</a> which is a fantastic little reporting application that has an open core. So this got me thinking... Can I put these two applications together and create a Reporting Layer with report embedding capabilities that is deployable in the cluster and has a admin UI accesible over a web page all whilst keeping the data locked to our network?</p>
|
||||
<h3>The Beginnings of an Idea</h3>
|
||||
<p>Ok so... Big first question. Can Duckdb and Metabase talk? Well... not quite. But first lets take a quick look at the architecture we'll be employing here </p>
|
||||
|
||||
@ -49,63 +49,84 @@ development and applying it in a strategic context.</p>
|
||||
<li>Containerised and Cloud Driven Data Architecture</li>
|
||||
</ul>
|
||||
<h1>EXPERIENCE</h1>
|
||||
<h2>Cloud Data Architect, Redeye Apps</h2>
|
||||
<p><em>May 2022 - Present</em>
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
- Design of Data Governance Process (Datahub driven)
|
||||
- Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)
|
||||
- CI/CD design and deployment of modelling and orchestration using Gitlab
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</p>
|
||||
<h2>Data Engineer, TechConnect IT Solutions</h2>
|
||||
<p><em>August 2021 – May 2022</em>
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
- Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)</p>
|
||||
<h2>Enterprise Data Warehouse Developer, Auto and General Insurance</h2>
|
||||
<p><em>August 2019 - August 2021</em>
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements</p>
|
||||
<h2>Business Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2018 - August 2019</em>
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
- Technologies used include VBA, PowerShell, SQL, Web API’s, SAS
|
||||
- Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</p>
|
||||
<h2>Forecasting and Capacity Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2017 – January 2018</em>
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
- Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation
|
||||
- Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</p>
|
||||
<h2>Senior HR Performance Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>June 2016 - January 2017</em>
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Workforce Business Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>July 2015 – June 2016</em>
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
- Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Cloud Data Architect</h2>
|
||||
<h3><em>Redeye Apps</em></h3>
|
||||
<h4><em>May 2022 - Present</em></h4>
|
||||
<ul>
|
||||
<li>Greenfields Research, Design and Deployment of S3 datalake (Parquet)</li>
|
||||
<li>AWS DMS, S3, Athena, Glue</li>
|
||||
<li>Research Design and Deployment of Catalog (Datahub)</li>
|
||||
<li>Design of Data Governance Process (Datahub driven)</li>
|
||||
<li>Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)</li>
|
||||
<li>CI/CD design and deployment of modelling and orchestration using Gitlab</li>
|
||||
<li>Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy</li>
|
||||
<li>Design of ETL/Pipelines (DBT)</li>
|
||||
<li>Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</li>
|
||||
</ul>
|
||||
<h2>Data Engineer,</h2>
|
||||
<h3><em>TechConnect IT Solutions</em></h3>
|
||||
<h4><em>August 2021 – May 2022</em></h4>
|
||||
<ul>
|
||||
<li>Design of Cloud Data Batch ETL solutions using Python (Glue)</li>
|
||||
<li>Design of Cloud Data Streaming ETL solution using Python (Kinesis)</li>
|
||||
<li>Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs</li>
|
||||
<li>Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)</li>
|
||||
<li>Apply Prebuilt ML models to software solutions (Sagemaker)</li>
|
||||
<li>Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)</li>
|
||||
<li>API testing and development (gRPC, Rest)</li>
|
||||
</ul>
|
||||
<h2>Enterprise Data Warehouse Developer</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>August 2019 - August 2021</em></h4>
|
||||
<ul>
|
||||
<li>ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL</li>
|
||||
<li>Bringing new data to the business to analyse for new insights</li>
|
||||
<li>Redeveloped Version Control and brought git to the data team</li>
|
||||
<li>Introduced python for API enablement in the Enterprise Data Warehouse</li>
|
||||
<li>Partnering with the business to focus data project on actual need and translating into technical requirements</li>
|
||||
</ul>
|
||||
<h2>Business Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2018 - August 2019</em></h4>
|
||||
<ul>
|
||||
<li>Automate Service Performance Reporting using PowerShell/VBA/SAS</li>
|
||||
<li>Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting</li>
|
||||
<li>Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends</li>
|
||||
<li>Technologies used include VBA, PowerShell, SQL, Web API’s, SAS</li>
|
||||
<li>Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel</li>
|
||||
<li>Gather Requirements to build meaningful reporting solutions</li>
|
||||
<li>Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</li>
|
||||
</ul>
|
||||
<h2>Forecasting and Capacity Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2017 – January 2018</em></h4>
|
||||
<ul>
|
||||
<li>Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers</li>
|
||||
<li>This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.</li>
|
||||
<li>Forecast inbound workload requirements for the Auto and General sales call center using time series analysis</li>
|
||||
<li>Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation</li>
|
||||
<li>Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy</li>
|
||||
<li>Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders</li>
|
||||
<li>Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</li>
|
||||
</ul>
|
||||
<h2>Senior HR Performance Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>June 2016 - January 2017</em></h4>
|
||||
<ul>
|
||||
<li>Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h2>Workforce Business Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>July 2015 – June 2016</em></h4>
|
||||
<ul>
|
||||
<li>Develop and refine current workforce analysis techniques and databases</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit</li>
|
||||
<li>Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h1>EDUCATION</h1>
|
||||
<ul>
|
||||
<li>2011 Bachelor of Business Management, University of Queensland</li>
|
||||
@ -113,8 +134,10 @@ development and applying it in a strategic context.</p>
|
||||
</ul>
|
||||
<h1>REFERENCES</h1>
|
||||
<ul>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
<em>0428 038 031</em></li>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
<em>0422 012 17</em></li>
|
||||
</ul></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry></feed>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health</li>
|
||||
</ul>
|
||||
<p><em>0428 038 031</em></p>
|
||||
<ul>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect</li>
|
||||
</ul>
|
||||
<p><em>0422 012 17</em></p></content><category term="Resume"></category><category term="Cover Letter"></category><category term="Resume"></category></entry></feed>
|
||||
@ -142,63 +142,84 @@ development and applying it in a strategic context.</p>
|
||||
<li>Containerised and Cloud Driven Data Architecture</li>
|
||||
</ul>
|
||||
<h1>EXPERIENCE</h1>
|
||||
<h2>Cloud Data Architect, Redeye Apps</h2>
|
||||
<p><em>May 2022 - Present</em>
|
||||
- Greenfields Research, Design and Deployment of S3 datalake (Parquet)
|
||||
- AWS DMS, S3, Athena, Glue
|
||||
- Research Design and Deployment of Catalog (Datahub)
|
||||
- Design of Data Governance Process (Datahub driven)
|
||||
- Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)
|
||||
- CI/CD design and deployment of modelling and orchestration using Gitlab
|
||||
- Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy
|
||||
- Design of ETL/Pipelines (DBT)
|
||||
- Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</p>
|
||||
<h2>Data Engineer, TechConnect IT Solutions</h2>
|
||||
<p><em>August 2021 – May 2022</em>
|
||||
- Design of Cloud Data Batch ETL solutions using Python (Glue)
|
||||
- Design of Cloud Data Streaming ETL solution using Python (Kinesis)
|
||||
- Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs
|
||||
- Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)
|
||||
- Apply Prebuilt ML models to software solutions (Sagemaker)
|
||||
- Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)
|
||||
- API testing and development (gRPC, Rest)</p>
|
||||
<h2>Enterprise Data Warehouse Developer, Auto and General Insurance</h2>
|
||||
<p><em>August 2019 - August 2021</em>
|
||||
- ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL
|
||||
- Bringing new data to the business to analyse for new insights
|
||||
- Redeveloped Version Control and brought git to the data team
|
||||
- Introduced python for API enablement in the Enterprise Data Warehouse
|
||||
- Partnering with the business to focus data project on actual need and translating into technical requirements</p>
|
||||
<h2>Business Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2018 - August 2019</em>
|
||||
- Automate Service Performance Reporting using PowerShell/VBA/SAS
|
||||
- Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting
|
||||
- Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends
|
||||
- Technologies used include VBA, PowerShell, SQL, Web API’s, SAS
|
||||
- Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel
|
||||
- Gather Requirements to build meaningful reporting solutions
|
||||
- Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</p>
|
||||
<h2>Forecasting and Capacity Analyst, Auto and General Insurance</h2>
|
||||
<p><em>January 2017 – January 2018</em>
|
||||
- Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers
|
||||
- This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.
|
||||
- Forecast inbound workload requirements for the Auto and General sales call center using time series analysis
|
||||
- Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation
|
||||
- Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy
|
||||
- Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders
|
||||
- Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</p>
|
||||
<h2>Senior HR Performance Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>June 2016 - January 2017</em>
|
||||
- Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Workforce Business Analyst, Queensland Department of Justice and Attorney General</h2>
|
||||
<p><em>July 2015 – June 2016</em>
|
||||
- Develop and refine current workforce analysis techniques and databases
|
||||
- Use VBA to automate regular reporting in Microsoft Access and Excel
|
||||
- Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit
|
||||
- Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required
|
||||
- Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</p>
|
||||
<h2>Cloud Data Architect</h2>
|
||||
<h3><em>Redeye Apps</em></h3>
|
||||
<h4><em>May 2022 - Present</em></h4>
|
||||
<ul>
|
||||
<li>Greenfields Research, Design and Deployment of S3 datalake (Parquet)</li>
|
||||
<li>AWS DMS, S3, Athena, Glue</li>
|
||||
<li>Research Design and Deployment of Catalog (Datahub)</li>
|
||||
<li>Design of Data Governance Process (Datahub driven)</li>
|
||||
<li>Research Design and Deployment of Orchestration and Modelling for Transforms (Dagster/DBT into Mesos)</li>
|
||||
<li>CI/CD design and deployment of modelling and orchestration using Gitlab</li>
|
||||
<li>Research, Design and Deployment of ML Ops Dev pipelines anddeployment strategy</li>
|
||||
<li>Design of ETL/Pipelines (DBT)</li>
|
||||
<li>Design of Customer Facing Data Products and deployment methodologies (Fully automated via Kakfa/Dagster/DBT)</li>
|
||||
</ul>
|
||||
<h2>Data Engineer,</h2>
|
||||
<h3><em>TechConnect IT Solutions</em></h3>
|
||||
<h4><em>August 2021 – May 2022</em></h4>
|
||||
<ul>
|
||||
<li>Design of Cloud Data Batch ETL solutions using Python (Glue)</li>
|
||||
<li>Design of Cloud Data Streaming ETL solution using Python (Kinesis)</li>
|
||||
<li>Solve complex client business problems using software to join and transform data from DB’s, Web API’s, Application API’s and System logs</li>
|
||||
<li>Build CI/CD pipelines to ensure smooth deployments (Bitbucket, gitlab)</li>
|
||||
<li>Apply Prebuilt ML models to software solutions (Sagemaker)</li>
|
||||
<li>Assist with the architecting of Containerisation solutions (Docker, ECS, ECR)</li>
|
||||
<li>API testing and development (gRPC, Rest)</li>
|
||||
</ul>
|
||||
<h2>Enterprise Data Warehouse Developer</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>August 2019 - August 2021</em></h4>
|
||||
<ul>
|
||||
<li>ETL development of CRM, WFP, Outbound Dialer, Inbound switch in Google Cloud, SAS, TSQL</li>
|
||||
<li>Bringing new data to the business to analyse for new insights</li>
|
||||
<li>Redeveloped Version Control and brought git to the data team</li>
|
||||
<li>Introduced python for API enablement in the Enterprise Data Warehouse</li>
|
||||
<li>Partnering with the business to focus data project on actual need and translating into technical requirements</li>
|
||||
</ul>
|
||||
<h2>Business Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2018 - August 2019</em></h4>
|
||||
<ul>
|
||||
<li>Automate Service Performance Reporting using PowerShell/VBA/SAS</li>
|
||||
<li>Learn and leverage SAS EG and VA to streamline Microsoft Excel Reporting</li>
|
||||
<li>Identify and develop data pipelines to source data from multiple sources easily and collate into a single source to identify relationships and trends</li>
|
||||
<li>Technologies used include VBA, PowerShell, SQL, Web API’s, SAS</li>
|
||||
<li>Where SAS is inappropriate use VBA to automate processes in Microsoft Access and Excel</li>
|
||||
<li>Gather Requirements to build meaningful reporting solutions</li>
|
||||
<li>Provide meaningful analysis on business performance and provide relevant presentations and reports to senior stakeholders.</li>
|
||||
</ul>
|
||||
<h2>Forecasting and Capacity Analyst</h2>
|
||||
<h3><em>Auto and General Insurance</em></h3>
|
||||
<h4><em>January 2017 – January 2018</em></h4>
|
||||
<ul>
|
||||
<li>Develop the outbound forecasting model for the Auto and General sales call center by analysing the relationship between customer decisions and workload drivers</li>
|
||||
<li>This includes the complete data pipeline for the model from identifying and sourcing data, building the reporting and analysing the data and associated drivers.</li>
|
||||
<li>Forecast inbound workload requirements for the Auto and General sales call center using time series analysis</li>
|
||||
<li>Learn and leverage the Aspect Workforce Management System to ensure efficiency of forecast generation</li>
|
||||
<li>Learn and leverage the capabilities of SAS Enterprise Guide to improve accuracy</li>
|
||||
<li>Liaise with people across the business to ensure meaningful, accurate analysis is provided to senior stakeholders</li>
|
||||
<li>Analyse monthly, weekly and intraday requirements and ensure forecast is accurately predicting workload for breaks, meetings and Leave</li>
|
||||
</ul>
|
||||
<h2>Senior HR Performance Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>June 2016 - January 2017</em></h4>
|
||||
<ul>
|
||||
<li>Harmonise various systems to develop a unified workforce reporting and analysis framework with appropriate metrics</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h2>Workforce Business Analyst</h2>
|
||||
<h3><em>Queensland Department of Justice and Attorney General</em></h3>
|
||||
<h4><em>July 2015 – June 2016</em></h4>
|
||||
<ul>
|
||||
<li>Develop and refine current workforce analysis techniques and databases</li>
|
||||
<li>Use VBA to automate regular reporting in Microsoft Access and Excel</li>
|
||||
<li>Act as liaison between shared service providers and executives and facilitate communication during the implementation of a payroll leave audit</li>
|
||||
<li>Gather reporting requirements from various business areas and produce ad-hoc and regular reports as required</li>
|
||||
<li>Participate in government process through the production of briefs including Questions on Notice and Estimates Briefs for departmental executives</li>
|
||||
</ul>
|
||||
<h1>EDUCATION</h1>
|
||||
<ul>
|
||||
<li>2011 Bachelor of Business Management, University of Queensland</li>
|
||||
@ -206,11 +227,13 @@ development and applying it in a strategic context.</p>
|
||||
</ul>
|
||||
<h1>REFERENCES</h1>
|
||||
<ul>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health
|
||||
<em>0428 038 031</em></li>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect
|
||||
<em>0422 012 17</em></li>
|
||||
<li>Anthony Stiller Lead Developer, Data warehousing, Queensland Health</li>
|
||||
</ul>
|
||||
<p><em>0428 038 031</em></p>
|
||||
<ul>
|
||||
<li>Jaime Brian Head of Cloud Ninjas, TechConnect</li>
|
||||
</ul>
|
||||
<p><em>0422 012 17</em></p>
|
||||
</article>
|
||||
|
||||
<hr>
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user