Skip to main content

Posts

Insta_Delete

Earlier this year I began playing with an open source instagram bot, InstaPy, after hearing the creator talk about web automation with selenium. I was very impressed and frankly amazed with what was possible with selenium and wanted to see how I could incorporate it in both my personal projects and professional career.

Since 2010, I had posted more images on IG than Flickr, 8,200+ with a good chunk of them "throw away" images. I already backed up my photos so now came the challenge to clean/delete my feed. Spring cleaning, pruning the hedges, whatever you want to call it, IG doesn't make it easy.

Enter Insta_Delete (no relation to the app that kept popping up in my google searches).

I decided to build myself a bot glorified script to first scroll as far back as possible on my feed, then scrape the page for URL's, parse and find the href links, save them to a file, log in with a mobile emulated browser and delete those old posts.







I wrote a script that is working now, …
Recent posts

Data Visualization with Python

Scatter plots with Matplotlib  I'm in the middle of taking a 6 week Data Visualization course at Code Academy so I guess you might call this a midterm project. In this jupyter notebook project, we have use real world space data (celestial star location ) for the Orion constellation and output a 3D scatter plot. This was fun but because it is an intro course, the project didn't even get to labeling the actual star which I thought was bunk. 
At the end of the project, they offer you a link to some star data and challenge you to plot some local stars. So I decided to publish my results that I will end up turning in for the extra credit portion of the project. (code below)
I picked a few stars, starting with some familiar ones, like Sirius, and started plotting it out. It took a while to get the labels on correctly, for some reason, I thought it was going to be easy but it definitely took some searching as the 3D portion of it made finding the examples far more challenging than t…

Copy SSIS packages from MS SQL SERVER 2008 R2

Copy SSIS packages from SQL Server 2008 R2 to another SQL Server 2008 First day at the new job I was asked if I knew anything about moving SSIS packages from one server to another server. The developer/dbo was dreading having to manually download and deploy the SSIS packages from the old server to the new server.

I quickly started looking for an automated, scripted solution and came across this stackoverflow post that was asking nearly the exact same question.  The only real difference was the original question was asking about  moving where as we needed to copy. (moving meant removing from old server as we nearly found out the hard way).

Below is the sql code from that post that I decided to group together on my github for sharing and for later use which by the way, I ended up reusing. I think making this into a stored procedure with a few more bells and whistles might come in handy. 
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 3…

004 - HTML Scraping with Beautiful Soup

Stream Our Mistakes EP 004


In this episode, Matt walks us through html/web scraping using the popular python library, Beautiful Soup.



Here's the code snippet from the session and links:

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47# Created for Stream Our Mistakes # https://streamourmistakes.blogspot.com/# Reference:# https://docs.python.org/3/library/urllib.request.html# https://www.crummy.com/software/BeautifulSoup/bs4/doc/frombs4importBeautifulSoupimporturllib.request''' # local html to play with from documentation Uncomment to enable html_doc = """<html><head><title>The Dormouse's story</title></head><body><p class="title"><b>The Dormouse's story</b></p><p class="story">Once upon a time there were three little sisters; and their names were<a href="http://exa…

003 - Convert User Creation to REST API endpoint using Django Framework

Stream Our Mistakes EP 003

In this episode, we will be working creating a REST API endpoint using Django REST Framework.  This will be a multi part series as I plan to use this backend with a Xamarin Android application. No guarantees it is going to work but I will attempt it anyways. This podcast/blog isn't called stream our mistakes for nothing aye?

I looked over a few youtube videos, this blog post and the excellent Django Rest Documentation.

Since this repo is not public, here is the code snippets that are relevant to the video.
Please note: This project assumes you have already implemented Django Rest Framework in your project.

In the Serializers.py file:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30fromrest_frameworkimportserializerfromdjango.contrib.auth.modelsimportUserclassUserCreateSerializer(serializers.ModelSerializer):classMeta:model=Userfields=('first_name','last_name','email','password',)extra…

Alert dialog for Xamarin Android

So it occurred to me this weekend that I have been working on a project these past couple months but haven't posted any videos. Partially, this is a private project so I won't publish the code at all. The more pressing reason is I'm really learning myself as I go so it really isn't pretty.

That being said, I considered posting some code to some of my biggest road blocks but felt that might slow down my progress. I've begun helping a friend who is new to coding and realized that it is beneficial to myself to write up and be able to share/teach those coming behind me.

I will be using the label android snippets to keep my notes in regards to this Xamarin Android application. I'll add a shortcut link in the blog soon. Here's the most recent headache I had.

I will look into possibly creating a class out of some of these snippets for myself.

Alert dialog for Xamarin Android:

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15AlertDialog.Builderalert=newAlertDialog.Builde…