babbaging

Transparent Android icons

2010-09-01T15:25:00.001+10:00

I have an Android phone and I wanted to create some new icons.

Inspired by various Andoid themes on xda-developers, I wanted text only icons.

I started whipping up icons in Photoshop, but it was a pain to try new fonts (yes I know PS has scripting...).

So I created a python script to generate a series of icons and zip them up.

The script uses Python Image Library, to render separate transparent PNG files.

from PIL import Image, ImageDraw, ImageFont
import zipfile
import os

class iconpack:
  def __init__(self, zipfsp, fontfsp, fontsize, height, width):
    self.zip=zipfile.ZipFile(zipfsp, mode='w')  # create the zip file
    self.fontfsp=fontfsp
    self.fontsize=fontsize
    self.h=height
    self.w=width

  def addicon(self,lines):
    iconfsp=self.render(lines)
    self.zip.write(iconfsp)  # add the icon tot he zip file
    os.remove(iconfsp) # delete the remaining icon file
    
  def render(self, lines):
    im =Image.new("RGBA",(self.w,self.h),(0,0,0,0))  # adjust the 4th zero to adjust transparency
    draw = ImageDraw.Draw(im)
    font = ImageFont.truetype(self.fontfsp,self.fontsize) # the font file needs to be accessible
    y=0
    for line in lines:
      rendered_hw=font.getsize(line)  # figure out how wide the rendered text will be
      x=im.size[0]/2-(rendered_hw[0]/2) # so we can centre it
      draw.text((x,y), line, font=font)
      y+=rendered_hw[1]-5   # adust the gap between the lines

    # write image file
    iconfsp=lines[0]+"_"+lines[1]+".png"
    im.save(iconfsp, "png")
    del im
    return iconfsp

    
# II saw an iconpack on xda which used 46x81, on the shoulders of giants, etc

# zipfile, font file, font size, width and height
ip=iconpack('DroidSans.zip','DroidSans.ttf',23,46,81) 
ip.addicon(["Inter", "Webs"])
ip.addicon(["My", "Email"])
ip.addicon(["Work", "Email"])
ip.addicon(["Snap", "Shot"])
ip.addicon(["Pod", "Casts"])
ip.addicon(["Audio", "Books"])
ip.addicon(["The", "Mrs"])
ip.addicon(["Bar", "Code"])
ip.addicon(["Four", "Square"])
ip.addicon(["SMS", ""])
ip.addicon(["Maps", ""])
ip.addicon(["Reddit", "is fun"])

Here's hows the icons turned out. I tried a few fonts from FontSpace, but settled on DroidSans.

Dear future self

2010-08-14T23:25:00.002+10:00

I found myself involved in a project which uses Nagios and Splunk to monitor IT infrastructure, and needed to know how to pass syslog messages from a Debian box to Splunk.

Of course I Googled, and to my surprise I found my own post in nagios-users, from over 3 years ago with exactly the same issue, albeit with older versions of the same software.

It was a pretty weird experience, one the one hand I thought it was great that mailing lists are there to be leveraged, repeatedly, but at the same time I realise I didn't learn the solution the first time.
I guess it a testement to Nagios, it's still a great product, still very relevant.

If we can just recall information it so easily, why bother learning it at all?
Better to know how to search, than how to learn.

There's value in making our information discoverable though, so this is note to my future self :
To forward Nagios event messages via syslog to a splunk server, configure data in on the splunk server to accept data on port 514, UDP.
Edit the config of syslog on the Nagios host to forward the messages to the splunk server by adding this line...
user.* @ip.add.of.splunk

Excel's short comings

2010-04-20T09:01:00.002+10:00

I used to be somewhat of an Excel fanboy.

Probably because I have found it to be entirely useful throughout my career (similarly I was a Lotus 1-2-3 fan too.)

However, the more I use Excel, and push it, the more I find what it cannot do.

Here, listed in no particular order, are my top three Excel 2007 disappointments.

1. No Median function in pivot tables.

This really is very frustrating, Median is a widely used function and would be entirely appropriate to include a pivot table summary function, yet it is not.

Sum, Count, Average, Max, Min, Product, Count Numbers, StdDev, StdDevP, Var and VarP are all included, but no Median. Excel is 23 years old, why has Median been left out?

2. Cannot record chart formatting macros.

You can in Excel 2003, but not in Excel 2007.

I used to frequently craft macros to make my charts look better and consistent and to reduce the chart formatting drudgery. My old macros still largely work, so I can use Excel 2003 to make new macros, but come on, really this is the way forward?

To get some idea how annoying this is, create ten line charts, each with 4 series, in each series have 12 points of data. Now add a red marker, point value, and series name to only the last data point of each series.

3. Perhaps this is a feature request, or perhaps I juts don;t know the trick, but when entering a formula, I would like to select a cell and be able to have it referenced as an Absolute Address.

In a long formula with a log of references, this would be a great time save.

I can't find it if it's an existing shortcut.

Excel is still a great product. I use it daily and cannot find a better replacement.

Kinetic scrolling with Processing - part1

2008-12-30T13:11:00.010+11:00

I've been toying with an idea for a timeline based project; it hasn't got much traction.
I did give the interface some thought and decided to try and implement a kinetic scroller.

It's pretty difficult to find a definitive explanation of Kinetic Scrolling or Flick Scrolling, but I think this pretty much sums it up:

"Kinetic scrolling is the popular term to denote the scrolling of a long list with a bit of physics so that user feels like moving a wheel. Such a list view is then often referred as a flick list, caused the scrolling involves some sort of flicking gestures. " [1]

Apple have a tutorial showing how to use their implementation here [2]

The physics are an illusion, and the approach I used is simple.

Click and hold the background to drag.
When drag is released, note how far it moved since the last draw.
Use that distance as the speed (or energy) of the scroll.
Continue moving in the same direction, but start reducing the speed (decay).
When the speed slow below a threshold, stop the scrolling.

I made a demo using Processing [3], click the image or here to start.
The coloured bars are just for showing the movement clearly.

[1] http://labs.trolltech.com/blogs/2008/11/15/flick-list-or-kinetic-scrolling/
[2] http://support.apple.com/kb/HT1636
[3] http://processing.org/

Ubiquity commands for openmoko searches

2008-09-07T12:35:00.003+10:00

I've been trying out Mozilla's Ubiquty, and I love it.
I hope it gets support and flourishes to the point of being the norm for interacting with the web.

My only gripe (so far) is I have to use it from within a browser, I wish was part of the wider OS, in the way Launchy is.

Anyway, here's a couple of commands to search Openmoko mailing lists and the Openmoko wiki.

makeSearchCommand({
name: "OM",
url: "http://openmoko.markmail.org/search/?q={QUERY}",
icon: "http://wiki.openmoko.org/favicon.ico",
description: "Searches Openmoko Mailing Lists for matching words."
});

makeSearchCommand({
name: "OMW",
url: "http://wiki.openmoko.org/wiki/Special:Search?search={QUERY}",
icon: "http://wiki.openmoko.org/favicon.ico",
description: "Searches Openmoko Wiki for matching words."
});

To add them to Ubiquity, use the command editor (you'll need Ubiquity installed).
Copy and paste the code and you good to go - real-time development, weird.

To use, invoke Ubiq and enter either commands OM or OMW.

Done.

Processing Nagios Status Data - part 1

2008-06-29T23:24:00.008+10:00

I've been tinkering with Processing of late, and having a lot of fun with it.

After finding the awsome traer physics library and Sean McCullough's implementation of force directed graph layout, I thought I would see if could visualise the status data from Nagios (..is an Open Source host, service and network monitoring program).

Essentially, after defining hosts (devices) and services (stuff the hosts provide), Nagios will monitor their performance.

I wrote a utility to extract the data I wanted from Nagios, and output an xml file.

I have plans to extend that as a seperate project - Nagiosity. The processing app uses the xml to constructs a graph. It's a bit rough, but I liked the result anyway.

The bigger circles are the hosts, the smaller circles are the servcies.

The more transparent the colour the older the status data.

Green is good, red is bad, the rest are somewhere in between.

The graph layout it's force directed, and uses an inverse gravity model; bigger mass repells.

We can use this property to create an intresting effect.

As the status data updates (every 10 secs) we adjust the mass slightly, and the graph reconfigures accordingly.

For failing services, or old data, we increase the mass, and they migrate to the edge of the screen. Click the image below and run the app, it's quite a neat organic effect.

Error creating gateway

2008-04-09T13:09:00.003+10:00

If you use ESX from Vmware, you may also use vRanger Pro from Vizioncore to backup VMs. Consider doing so, it's great.

If you are already and you start getting backup failures, with 'Error creating gateway' in the log, check to see if someone has changed the root password on the ESX hosts.

If the password has changed, you need to go into Configuration/VMware Hosts//Modify Host and update the password, for each vmware host.

I speant a good few of hours figuring that out. :(

Teracopy

2008-02-02T22:51:00.000+11:00

Every so often a nice little utility comes a long, and it makes stop and wonder why the OS vendors didn't include it as part of the OS.

Teracopy is a small windows utility from Code Sector which replaces the tediously slow native file copying process.

Essentially it provides file copy queues.

Find the file you want to copy, right click use the context menu to use Teracopy, Copy to.. etc, start the copy process.

Want to copy another file to the same place?
Just drag it to the existing copy dialog and it will be added to the queue.
So simple and intuitive.

I love it. and it will be part of my essential installs.

Australian product recalls feed

2007-07-04T00:05:00.000+10:00

I'm a subscriber of Choice magazine (Australia) and a supporter of their campaigns.
Towards the back of each issue there is a couple of pages listing product recalls. I typically scan through them, but there's a lot and the format is not great.

The same information is provided online by the Australian government, here.
It's not the most attractive website, but it probably supports every browser and let's face it how slick does it need to be?

If the style doesn't date it, the lack of RSS does, and that's what I was after, a low volume feed.
I emailed the address on the contact page, but I haven't heard back, so I though I'd just scrape the pages for data and fabricate my own feed.

I tried using feed43.com, a service specifically designed to scape content from html to produce rss feeds. However, there's no facility to pull content from multiple sources, so the feed it produced was not much more than a teaser, no good for my offline reader.

I decided to write my own, using python.
A quick Google for a python module located PyRSS2Gen.

Essentially, this the the processes :

Download the web page with a list of product recall in the last 30 days.
Locate and extract the individual recalls using regular expresions.
Download each recalled item's information page.
Extract the details of the recall.
Construct an RSS feed from the scraped content.

Here's the code, and the resulting rss feed.
A cron job runs every day, and updates the feed.

What is a book ?

2007-04-26T21:59:00.000+10:00

First I saw the cover of an old novel pop up on my LibraryThing collection and then, a post about Ludditism on Digital History Hacks reminded me of the same novel, and today a post titled Bio-Optic Organized Knowledge Review, reminded me of it again.
The novel, Days by James Lovegrove is an old favorite of mine, and a significant section of the plot revolves around an escalating conflict between a book shop and a computer shop.

What sticks in my mind is this lovely piece about books, spoken by Miss Dalloway the Luddite bookshop manager.

"A book. As a source of easily retrievable information, portable, needing no peripheral support systems, instantly accessible to anyone on the planet old enough to read and turn a page, a book is without peer. A book does not come with an instruction manual. A book is not subject to constant software upgrades. A book is not technologically outmoded after five years. A book will never ‘go wrong’ and have to be repaired by a trained (and expensive) technician. A book cannot be accidentally erased at the touch of a button or have it’s contents corrupted by magnetic fields. Is it possible to think of a object on this earth more – horrible term – user-friendly than a book?"

That was written in 1997, when computers were outmoded in five years. (yeah right)

I've long since been waiting for the arrival of e-ink, I have wanted a good ebook reader for years and this post on Signal vs Noise, gives an encouraging review of the Sony Reader PRS-500 (massive image), encouraging enough for me to look around this room for something to sell.

Books they be changing.

Python, Amazon, graphs, oh my! : Part 3

2007-04-22T09:05:00.000+10:00

In previous posts here and here, I looked at a reading list on Digital History Hacks, and examined the liked between the books and suggested new book, using Amazon's API.

I wrote my scripts with the idea of looking at some other reading lists, one such list is from the Long Now Foundation (list). Read about the foundation here, and listen to their superb seminar series here.

The majority of the code work has been done, we can take the original script (scrape1.py) and tweak it for the new list.
All that's required is the new source of data (URL), an appropriate regular expression pattern to identify the ASINs and a new prefix to keen the results separate from previous tinkerings.
Here are the changes...

#the page we want to scrape
URL='http://www.longnow.org/shop/books/'

# the pattern we want to look for
PAT="ASIN\/([0-9]+[X]*)"

# the prefix for the filename
filename='ln'

This produces an new pickle of ASINs, and the file name is usefully prefixed, ln_asins.pik.
Now all we have to do is alter the filename prefix in graph4.py and that will produce the following SVG, bitmap below.

I though the list would be more connected, and I was initially surprised how few connections there are. On reflection, the Long Now covers a broad range of subjects and the connection between them is the foundation.

Still we can still search through Amazon's similar product suggestion and see what recommendations we can offer.
Change prefix in graph5.py and amazon offers up 280 items, we'll use any suggestion with more than a third of the connections of the more connected original.
here's the results. (SVG)
Well, there's plenty going on here, too much maybe.
The neat and tidy cluster in the top right is by the historian and author Daniel J. Boorstin.
There's another cluster where three titles, previous unconnected, become connected.
So if you're interested in these...

When Good Companies Do Bad Things: Responsibility and Risk in an Age of Globalization
Built to Last: Successful Habits of Visionary Companies (Hardcover)
Guns, Germs, and Steel: The Fates of Human Societies (Paperback)

...the consider these...

The World Is Flat [Updated and Expanded]: A Brief History of the Twenty-first Century (Hardcover)
Good to Great and the Social Sectors: A Monograph to Accompany Good to Great (Paperback)
Blink: The Power of Thinking Without Thinking (Paperback)
The Tipping Point: How Little Things Can Make a Big Difference (Paperback)

The large node is actually a duplicate of another title but an alternate format.
Perhaps a future version will include some dupe checking, LibraryThing's API provides for matching ISBNs and titles.

Python, Amazon, graphs, oh my! : Part 2

2007-04-17T21:36:00.000+10:00

In this post we looked at Digital History Hack's proposed reading list and visualised it using using Graphviz's SVG output.

Now lets finish what was started and add in the book titles which are considered considered similar by Amazon.

From the original list, Amazon suggest nearly 780 titles, that's clearly not useful.
I've chosen to limit to those which have at least a third of the number of the most connected.

The new books added as new nodes and have a double circle node shapes.

The Long Tail: Why the Future of Business Is Selling Less of More
Wikinomics: How Mass Collaboration Changes Everything
Everyware: The Dawning Age of Ubiquitous Computing
The Victorian Internet

Heres the code graph5.py and the SVG, bitmap below.

Python, Amazon, graphs, oh my!

2007-04-14T14:42:00.000+10:00

I'm a regular reader of William J Turkel's blog, Digital History Hacks.
His recent posts (here and here) about analysing his course's reading list inspired some tinkering of my own.

In William's first post on the subject, he uses the ASIN (Amazon Standard Identification Number) from each of the books in his reading list and Amazon's API to request a list of similar books.
This generates a list of paired ASIN, up to 10 pairs per original title.

Original Title ASIN 1, Similar Title ASIN 1
Original Title ASIN 1, Similar Title ASIN 2
Original Title ASIN 1, Similar Title ASIN 3
Original Title ASIN 2, Similar Title ASIN 1
Original Title ASIN 2, Similar Title ASIN 2
Original Title ASIN 2, Similar Title ASIN 3

And as William shows these pairs can be used to construct a graph, which can be used to visualise the degree of connectivity of the reading list.

My code uses parts of Williams's so if it looks familiar, that's why.

First scrape the ASIN from the webpage, my version of this script is here scrape1.py.

So we have our list of paired ASIN, so let's query amazon and get some similar titles.
You'll need to get your own Amazon Web Service ID which is a trivial enough process.

I have a couple of simple calls to help extract the data we want, in a module called amazon.py.
The process is simple enough.

Load the pickled ASINs
Query Amazon
Compile a list of ASIN pairs
Pickle and save the list of pairs.

The code for that is here, get_similar1.py

I found this article, Python MiniDom, useful when playing with the XML data returned by Amazon, and theres a more comprehensive Amazon wrapper project for python, pyAWS.

OK, so now we have a list of pairs, we can start to play with Graphviz.
There's a lovely Python interface for Graphviz, pydot which I think is great.
Basically using pydot, graphs, nodes and edges become objects and this make it very easy to use.
Let's start by graphing all the original ASINs, and show links where they are similar to each other.

Load the pickled ASINs
Load the pickled ASIN pairs
Create a graph object
Create a node object for ASIN and add to the graph
Create an edge object for each linked original ASIN
Save the graph

Here's the code, graph1.py , and here the resulting graph.

It's quite clear that many of these books are considered similar by amazon, and some stand out much more than others as hubs in a network.

We can quantify that connectedness, and use the data to alter the graphs appearance.

If we count he number of nodes which connect to or from other nodes, we can apply that to the font size, which is often done in tag clouds.

To do this is quite simple, we'll use a dictionary object to assign a value to each ASIN, and as we cycle through the pairs we'll increment the value.

Then, when we create the node, we'll set the font size.

here's the code to calculate the weights:

# for each ASIN associate a value
weight={} for asin in asins: weight[asin]=0

# for each pair
for pair in pairs:
# only if they are one of the originals
if pair[1] in asins: # increment the weight
weight[pair[1]]+=1
weight[pair[0]]+=1

and here is where that value is used, and while we're at it let's make the nodes circles.

# add a node for each original title for asin in asins:
node=pydot.Node(asin, shape='circle', fontsize=8+weight[asin])
g.add_node(node)

the new code, graph2.py and the results...

The larger circles make quite a difference, but for some reason my system does have the right fonts. I think it still illustrates how by calculating and using the weight data we can make the over all picture clearer.
At this point the jpg files are getting large, and the quality is not that great. An alternative graphics format is Scalable Vector Graphics (SVG). Read about it at W3C and at Wikipedia. Firefox has native support for SVG and Adobe provide a viewer.

This format will provide nice fonts and smooth lines and curves, and some other useful features, which we'll get to later.

OK, let's use that weight value again, this time to add some color and view as an SVG.
I have a helper module called gradi.py, which has some functions which generate colour gradients, we can use this to calculate colours for our nodes.
Starting with yellow for node with no connections, and red for those with the most, everything between we'll make orangish.

First we define our colour range and gradient.

loColor=gradi.HTMLColorToRGB('FFCC00')
hiColor=gradi.HTMLColorToRGB('FF0000')
colourgradient=1.0/max(weight.values())

Now when we define our node, we'll calculate the colour and fill the circle.

color=gradi.RGBToHTMLColor(gradi.RGBinterpolate(loColor,hiColor,colorgradient*weight[asin])) node=pydot.Node(asin, shape='circle',style='filled', fillcolor=color, _ fontsize=8+weight[asin])

And then save as SVG

g.write(output_filename+'.svg',format='svg')

Here the modified script, graph3.py and the results, click the image or here for the SVG.
I recommend this Firefox Zoom and Pan extension for SVG files.

I prefer the look of the SVG files and the format provides some useful features that bitmaps can't, for instance we can have Graphviz add http links from the nodes and edges, and include tooltips too. Hovering over nodes will show the title, and clicking will open the Amazon product page.

To add this functionality we just query Amazon for the title and include that data as a node attribute.

node.set_URL('http://www.amazon.com/gp/product/'+asin)
node.set_tooltip(amazon.getelement(amazon.AmazonAPI(asin),'Title'))

Here the adjusted script, graph4.py and a link the new interactive SVG.

I think this is a great improvement over a bitmap of product codes.
In part two we'll add the titles which were suggested by Amazon.

PowerChute Network Shutdown agent for VMWare ESX v3.01

2007-03-12T11:55:00.000+11:00

First things first, get the software and install it.

Soft ware available here :
http://www.apcc.com/tools/download/index.cfm

Installation guide available here:
PowerChute Network Shutdown : Installation v.2.2.1 (www.apcc.com)

What isn't mentioned in the install notes, is that the esx firewall will not let your register the device with the UPS.

Open port 80
/usr/sbin/esxcfg-firewall -o 80,tcp,out,http

Now proceed with the install and then close the port.
/usr/sbin/esxcfg-firewall -c 80,tcp,out,http

Ok, after this you should see the new client device listed in the UPS's management web pages.
Now if you leave this as is, you will carry on your busy life feeling you have a slightly less risk of something awful happening should there be a significant power failure.

Wrong.
The port used by the UPS to communicate the shut down event, is closed, your lovely ESX server will never know.

Open the port.
/usr/sbin/esxcfg-firewall -o 3052,tcp,in,PowerChute

Strictly speaking this not no APC's fault, but they could at least put a note, "Check port 3052 is not blocked!".

There is no way to really simulate a Shutdown event for only one device, the agents are devout believers and will not ignore the command to shutdown.
The UPS signals each listed device and also broadcasts it too.
You could shutdown the agent on all other devices and send a Shutdown signal from the management pages. Don't for get to enable the agents after though.

Use nmap to test the port is open :

nmap host -p3052

Starting Nmap 4.11 ( http://www.insecure.org/nmap/ ) at 2007-03-12 12:19 EST
Interesting ports on xxx.xxx.com (nnn.nnn.nnn.nnn):
PORT STATE SERVICE
3052/tcp open PowerChute
MAC Address: hh:hh:hh:hh:hh:hh (VMWare)

That's it, Good luck.