Skip to content
Digital, Data, AI, Analytics

Enabling analytics, AI, and digital capabilities

  • About
Digital, Data, AI, Analytics

Enabling analytics, AI, and digital capabilities

FitSignals – Google Watch Fitbit data and visualization

Javascript, MongoDB, Node.js, Plotly, Python

Unlock the Hidden Power of Your Fitbit Data FitSignals transforms your Fitbit data into comprehensive, interactive visualizations that reveal insights […]

FitSignals – Google Watch Fitbit data and visualization Read More »

DeepMind Materials new crystal structure data analysis

Python, Science

A recent Google DeepMind project paper Scaling deep learning for materials discovery described using GNNs trained on a large and

DeepMind Materials new crystal structure data analysis Read More »

DeepMind AlphaMissense matched to 23andMe data

Python, Science

TLDR: It is pretty cool that you can directly leverage Deepmind’s cutting edge AI powered AlphaFold and AlphaMissense projects to

DeepMind AlphaMissense matched to 23andMe data Read More »

Voip.ms get call detail records and set call detail record filters using API

API, Python

Voip.ms is a reliable, affordable and customizable VoIP service. Sign-up with my referral code to get $10 discount. Recently I

Voip.ms get call detail records and set call detail record filters using API Read More »

OpenAI ChatGPT 4 Advanced Data Analysis used to do river water flow analysis

ChatGPT, Environmental science, Python

OpenAI ChatGPT 4 Advanced Data Analysis is pretty amazing! I put it to the test on some data I analysed

OpenAI ChatGPT 4 Advanced Data Analysis used to do river water flow analysis Read More »

CBC news article comments analysis and visualization

BeautifulSoup, NetworkX, NLTK, Python

This post is focuses on a project of the analysis of scaped comments from CBC News website articles. (BTW, there

CBC news article comments analysis and visualization Read More »

CBC news comment and replies interaction network visualization

BeautifulSoup, NetworkX, NLTK, Python

The CBC (Canadian Broadcasting Corporation) news website articles often have a comments section. It would be interesting to see the

CBC news comment and replies interaction network visualization Read More »

CBC news article comments web scraping

BeautifulSoup, Javascript, NetworkX, NLTK, Python, Web Development

This post is focuses on a project where I scaped comments from CBC News website articles. (BTW, there are lots

CBC news article comments web scraping Read More »

Canadian Government First Nations long term water advisory data

Business Intelligence, Excel Pivot Chart, Excel Pivot Table, Javascript, Plotly, Power Query, Python, Web Development

The Government of Canada is working with Canadian First Nations communities to end long-term drinking water advisories which have been

Canadian Government First Nations long term water advisory data Read More »

COVID-19 Data Analysis and Visualization Summary

Amazon Web Services (AWS), D3.js, Geocoding, Javascript, Plotly, Power Query, Python

This is a list of Canadian COVID-19 related data analysis and visualization that I created during 2020/21 pandemic. Canada COVID-19

COVID-19 Data Analysis and Visualization Summary Read More »

TendiesTown.com – WallStreetBets gain and loss analysis

API, Django, Plotly, Python

For a 16 month period, from February 2020 to June 2021, TendiesTown.com used the Reddit API in an automated process

TendiesTown.com – WallStreetBets gain and loss analysis Read More »

Sir Patrick Stewart @SirPatStew #ASonnetADay dashboard

API, Javascript, Plotly, Python, Twitter API

Sir Patrick Stewart @SirPatStew was doing Shakespeare Sonnet readings from his home during the COVID-19 lockdown and they were really

Sir Patrick Stewart @SirPatStew #ASonnetADay dashboard Read More »

Amazon AWS Transcribe used to get 2020 presidential debate #1 speaker segments

Amazon Web Services (AWS), Plotly, Python

TLDR: I used Amazon Transcribe to transcribe the first presidential debate audio that included timestamps for each word, to create

Amazon AWS Transcribe used to get 2020 presidential debate #1 speaker segments Read More »

Amazon AWS Textract – WHO “Draft landscape of COVID-19 candidate vaccines” – convert PDF to csv

Amazon Web Services (AWS), Python

TLDR: I extracted text from the WHO’s vaccine candidate PDF file using AWS Textract and made text into a set

Amazon AWS Textract – WHO “Draft landscape of COVID-19 candidate vaccines” – convert PDF to csv Read More »

Periodic chart elements by origin from SVG using Python

Plotly, Python

This cool periodic chart of the elements shows source / origin of the chemical elements. Source: Wikipedia created by Cmglee

Periodic chart elements by origin from SVG using Python Read More »

Retrieve and process Environment Canada hydrometric and climate data using Python

Environmental science, Python

Recently needed to get flow and level data for a watercourse hydrological station as well as regional precipitation data for

Retrieve and process Environment Canada hydrometric and climate data using Python Read More »

Plotly Express Python remove legend title

Plotly, Python

Plotly.py 4.5, Plotly Express no longer puts the = in trace names, because legends support titles (source). Prior to Plotly.py

Plotly Express Python remove legend title Read More »

Scraping public health web page using Python, BeautifulSoup4, Requests and Pandas

Amazon Web Services (AWS), BeautifulSoup, Python

During the 2020 COVID-19 pandemic in Canada I wanted to get COVID-19 confirmed cases counts data for the city of

Scraping public health web page using Python, BeautifulSoup4, Requests and Pandas Read More »

Choropleth map of Canada COVID-19 cases by health region using Leaflet and D3.js

D3.js, Geocoding, Javascript, Python

During the early days of the 2020 COVID-19 pandemic in Canada, I wanted to get better understanding of the geographical

Choropleth map of Canada COVID-19 cases by health region using Leaflet and D3.js Read More »

GlobalPrePaidCreditCard.com – Prepaid and gift credit card feature comparison for multiple countries

Django, Python, Web Development

GlobalPrePaidCreditCard.com – Prepaid and gift credit card feature comparison for 9 countries. Sort and filter cards by features to find the

GlobalPrePaidCreditCard.com – Prepaid and gift credit card feature comparison for multiple countries Read More »

How to use Python as a datasource for Power BI

Power BI, Python

Step 1 – Download latest version of Power BI to get new features (version that came out in early August

How to use Python as a datasource for Power BI Read More »

BC Executive Compensation Tableau Visualization

Python, Tableau

The Province of British Columbia publishes public agency executive compensation each year. The data is grouped by: Sector – Employers

BC Executive Compensation Tableau Visualization Read More »

Twitter Followers and List Membership Tracking

Amazon Web Services (AWS), API, Chart.js, Python, Twitter API

I have created my own historical reporting of my Twitter account followers and list memberships. I have hosted the reporting

Twitter Followers and List Membership Tracking Read More »

Django form geocode submitted address to get lat, lon and postal code

Django, Geocoding, Python, Web Development

One of my Django applications includes a form where user can enter and submit a property address. The user submitting the form

Django form geocode submitted address to get lat, lon and postal code Read More »

Leaflet.js choropleth map color by count using geoJSON datasource

Django, Geocoding, Javascript, Postgres, Python, Web Development

I have a Django web application that needed an interactive map with shapes corresponding to Canadian postal code FSA areas

Leaflet.js choropleth map color by count using geoJSON datasource Read More »

Python get image color palette

Postgres, Python

I created a web application that included screenshots of about 190 country’s national statistics agencies website home page. I created the site

Python get image color palette Read More »

Django recreate database table

Django, Python

Django’s makemigrations and migrate commands are very useful to update existing database tables to reflect model changes. However if you

Django recreate database table Read More »

Canadian TCS FDI Officers Twitter list member analysis

Python, Tableau, Twitter API

Blog post updated to add the following: Updated Python “TCS Members Details” code to get additional information from the List

Canadian TCS FDI Officers Twitter list member analysis Read More »

How to use Google Adsense API to download Adsense data

API, Google Adsense, Python

Google’s APIs make getting Adsense (or any other Google service) data easy to download. The code below downloads Adsense data

How to use Google Adsense API to download Adsense data Read More »

Create Python 3 Virtualenv on machine with Python 2 & 3 installed

Python

I have been using Python 2.7 for most of my Python work but have a few projects where I want

Create Python 3 Virtualenv on machine with Python 2 & 3 installed Read More »

Use OneDrive API to upload files to Office 365 Sharepoint Site

Azure, Office 365, OneDrive, Python, Sharepoint

I have automated uploading files from my web site host’s server to my Office 365 Sharepoint site using scheduled cron jobs running

Use OneDrive API to upload files to Office 365 Sharepoint Site Read More »

OneDrive API features

API, Azure, Office 365, OneDrive, Power BI, Python, Sharepoint

Microsoft has three file storage options: OneDrive Personal OneDrive Business Sharepoint These have recently been unified into one new OneDrive API https://dev.onedrive.com and oAuth

OneDrive API features Read More »

Tracking Cuba Gooding Jr’s Twitter follower count

Google Charts, MySQL, Python, Twitter API, Web Development

Happened to see Cuba Gooding Jr’s first tweet about 30 minutes or so after he created it. Update: @cubagoodingjr is no

Tracking Cuba Gooding Jr’s Twitter follower count Read More »

Dell ecommerce web site scraping analysis

BeautifulSoup, Python

Once upon a time, I needed to find Dell monitor data to analyse. A quick search brought me to their eCommerce

Dell ecommerce web site scraping analysis Read More »

Always remember to start Python Virtualenv

Django, Python

When learning to develop Django and Flask Python applications using virtual environment I did not know that I should activate

Always remember to start Python Virtualenv Read More »

Flask SQLAlchemy relationship associations and backref

Flask, Python, SQLAlchemy

Flask-SQLAlchemy relationship associations are useful to easily retrieve related records from a related Model. In a Python Flask application I

Flask SQLAlchemy relationship associations and backref Read More »

Get list of custom segments from Google Analytics API

Google Analytics, Python

This is a post on how to create custom Google Analytics Profile Segments for the purpose of removing referral spam

Get list of custom segments from Google Analytics API Read More »

BC Hydro’s amazing #BCStorm social media turnaround

Power BI, Power Query, Python, Twitter API

BC Hydro made an amazing social media turnaround to communicate with customers in crisis! Go BC Hydro! On August 29,

BC Hydro’s amazing #BCStorm social media turnaround Read More »

How to filter referral spam from Google Analytics using API and Python

API, Google Analytics, Python

Google Analytics data has become incredibly polluted by “spam referrals” which inflate site visits with what are essentially spam advertisements

How to filter referral spam from Google Analytics using API and Python Read More »

Tableau vizualization of Toronto Dine Safe data

API, Geocoding, Python, Tableau

The City of Toronto’s open data site includes the results of the city’s regular food and restaurant inspections. This data

Tableau vizualization of Toronto Dine Safe data Read More »

LinkedIn ‘People You May Know’ web scraping and analysis

BeautifulSoup, Python

A while back LinkedIn sneakily vacuumed up all of my contacts from my phone via the Android Cardmunch app. Turns

LinkedIn ‘People You May Know’ web scraping and analysis Read More »

Log in

Recent Blog Posts

  • Using Microsoft Fabric to serve multi-tenant data & analytics
  • A Shift in Tone: Unpacking Sam Altman’s Bold AGI Claims
  • Canada’s productivity puzzle – tale of a cautious Canadian owner class
  • First-time journey publishing an app to the Google Play Store
  • FitSignals – Google Watch Fitbit data and visualization
  • Radio wave light spheres – radio waves washing over nearby stars
  • Visualization of tennis player rank vs match outcome and betting odds
  • DeepMind Materials new crystal structure data analysis
  • DeepMind AlphaMissense matched to 23andMe data
  • Apache EChart alternative faux legend solution

Blog Categories

  • AI & ML (3)
  • Amazon Web Services (AWS) (7)
  • API (10)
  • Azure (4)
  • BeautifulSoup (6)
  • Business Intelligence (3)
  • CakePHP (3)
  • Chart.js (2)
  • ChatGPT (3)
  • D3.js (6)
  • Dart (1)
  • Django (7)
  • EChart.js (2)
  • Economics (1)
  • Environmental science (3)
  • ERP (1)
  • Excel Pivot Chart (4)
  • Excel Pivot Table (4)
  • Fabric (3)
  • Flask (1)
  • Flutter (1)
  • Geocoding (6)
  • Google Adsense (1)
  • Google Analytics (3)
  • Google Calendar (1)
  • Google Charts (2)
  • Google Maps API (2)
  • Google Play (1)
  • Google Script (1)
  • Hadoop (2)
  • Javascript (18)
  • LLM (1)
  • Microsoft Copilot (1)
  • Mobile App Dev (1)
  • MongoDB (1)
  • MS Access (1)
  • MySQL (2)
  • NetworkX (3)
  • NLTK (3)
  • Node.js (1)
  • Office 365 (9)
  • OneDrive (4)
  • Open Data (1)
  • OpenAI (1)
  • Palm Pilot (1)
  • PHP (3)
  • Plotly (8)
  • Postgres (2)
  • Power BI (13)
  • Power Query (11)
  • Python (41)
  • QGIS (1)
  • Qlikview (1)
  • SaaS (1)
  • Science (4)
  • Sharepoint (6)
  • SQLAlchemy (1)
  • Tableau (6)
  • Twitter API (6)
  • VBA (1)
  • Web Development (14)
  • Xero (1)
  1. Curtis on Django form geocode submitted address to get lat, lon and postal codeMay 30, 2021

    Django forms have some complexity when first encountered. Recommend following any basic Django forms tutorial, and applying to your specific…

  2. NS on Django form geocode submitted address to get lat, lon and postal codeMay 30, 2021

    Ah yes that does help to clear it up. However, I’m facing an issue now that whenever my form is…

  3. Curtis on Django form geocode submitted address to get lat, lon and postal codeMay 25, 2021

    Hey NS, The data is saved to database by the form post action eg starting with: if request.method == 'POST':.…

  4. NS on Django form geocode submitted address to get lat, lon and postal codeMay 25, 2021

    Hi Curtis, I’m relatively new to django and I’m trying to create a Django application where i can get a…

  5. Curtis on Legend and polygon colors for Leaflet choropleth using Chroma.jsMay 5, 2021

    Looks like it is working fine but my code was missing a line break at the end of if then…

  • About
  • AI Image Describe Android App
  • COVID-19 Data Analysis and Visualization
  • Environmental Science Experience
  • Blog

Copyright © 2025 Digital, Data, AI, Analytics