Text* Snippets: jamiew

Capistrano task to load production data

jamiew (Jamie Wilkinson) — Fri, 21 Sep 2007 16:52:24 GMT



# load production data, still needs some polish

# based on code from http://push.cx/2007/capistrano-task-to-load-production-data

# cap 2.0 compatible

# exec is being weird, had to end w/ a syscall :\ any ideas?



desc "Load production data into development database"

task :load_production_data, :roles => :db, :only => { :primary => true } do

  require 'yaml'

  ['config/database.yml'].each do |file|



    database = YAML::load_file(file)



    filename = "dump.#{Time.now.strftime '%Y-%m-%d_%H:%M:%S'}.sql.gz"

    # on_rollback { delete "/tmp/#{filename}" }



    # run "mysqldump -u #{database['production']['username']} --password=#{database['production']['password']} #{database['production']['database']} > /tmp/#{filename}" do |channel, stream, data|

    run "mysqldump -h #{database['production']['host']} -u #{database['production']['username']} --password=#{database['production']['password']} #{database['production']['database']} | gzip > /tmp/#{filename}" do |channel, stream, data|

      puts data

    end

    get "/tmp/#{filename}", filename

    # exec "/tmp/#{filename}"

    password = database['development']['password'].nil? ? '' : "--password=#{database['development']['password']}"  # FIXME pass shows up in process list, do not use in shared hosting!!! Use a .my.cnf instead

    # FIXME exec and run w/ localhost as host not working :\

    # exec "mysql -u #{database['development']['username']} #{password} #{database['development']['database']} < #{filename}; rm -f #{filename}"

    `gunzip -c #{filename} | mysql -u #{database['development']['username']} #{password} #{database['development']['database']} && rm -f gunzip #{filename}`

  end

  

end

Get remote file size, following redirects (PHP)

jamiew (Jamie Wilkinson) — Thu, 20 Sep 2007 19:05:41 GMT



function get_remote_file_size($url, $readable = true){

   $parsed = parse_url($url);

   $host = $parsed["host"];

   $fp = @fsockopen($host, 80, $errno, $errstr, 20);

   if(!$fp) return false;

   else {

       @fputs($fp, "HEAD $url HTTP/1.1\r\n");

       @fputs($fp, "HOST: $host\r\n");

       @fputs($fp, "Connection: close\r\n\r\n");

       $headers = "";

       while(!@feof($fp))$headers .= @fgets ($fp, 128);

   }

   @fclose ($fp);

   $return = false;

   $arr_headers = explode("\n", $headers);

   foreach($arr_headers as $header) {

			// follow redirect

			$s = 'Location: ';

			if(substr(strtolower ($header), 0, strlen($s)) == strtolower($s)) {

				$url = trim(substr($header, strlen($s)));

				return get_remote_file_size($url, $readable);

			}

			

			// parse for content length

       $s = "Content-Length: ";

       if(substr(strtolower ($header), 0, strlen($s)) == strtolower($s)) {

           $return = trim(substr($header, strlen($s)));

           break;

       }

   }

   if($return && $readable) {

			$size = round($return / 1024, 2);

			$sz = "KB"; // Size In KB

			if ($size > 1024) {

				$size = round($size / 1024, 2);

				$sz = "MB"; // Size in MB

			}

			$return = "$size $sz";

   }

   return $return;

}

Never render the full layout in a Rails view when called via AJAX

jamiew (Jamie Wilkinson) — Sun, 09 Sep 2007 20:08:06 GMT

Essential for degradable javascript, when one never knows if a view or partial is being called via XmlHttpRequest or not. Throw the below code in your ApplicationController (application.rb)

More info in this blog post



def render(*args)

  	args.first[:layout] = false if request.xhr? and args.first[:layout].nil?

	super

end

Standard CSS helpers

jamiew (Jamie Wilkinson) — Tue, 28 Aug 2007 17:26:09 GMT

Some really common layout classes I use in almost every CSS file.



/********* helpers *********/

.floatRight { float: right; }

.floatLeft  { float: left; }

.right  { text-align: right; }

.left   { text-align: left; }

.center { text-align: center; }

.clear, .clearer { clear: both; }

.block  { display: block; }

AppleScript to test if application is running

jamiew (Jamie Wilkinson) — Wed, 11 Jul 2007 00:24:23 GMT

By name:



tell application "System Events" to (name of processes) contains "iTunes"

By creator type, in case it might have a version # appended:



tell application "System Events" to (creator type of processes) contains "InDn"

Grab creator type dynamically like so:



tell application "Finder" to creator type of (selection as alias)

From http://applescriptsourcebook.com/viewtopic.php?pid=46830

Cache a local copy of Google Analytics' urchin.js

jamiew (Jamie Wilkinson) — Thu, 05 Jul 2007 18:31:41 GMT

Speed up your website by caching Google's urchin.js locally, and then refreshing it @nightly with this here script. Some background: http://tramchase.com/blog/broken-urchintracker-calls-google-analytics-down



#!/bin/sh

# urchin.js local caching by Jamie Wilkinson 



# config

DIR=/directory/where/you/want/js



# work

URCHIN=$DIR/urchin.js

wget http://www.google-analytics.com/urchin.js -O $URCHIN.tmp

if [ -s $URCHIN.tmp ]; then

        rm $URCHIN

        mv $URCHIN.tmp $URCHIN

        chmod 644 $URCHIN

fi



exit 0;

Handling filenames with spaces in a bash for or while loop

jamiew (Jamie Wilkinson) — Tue, 26 Jun 2007 16:07:29 GMT

// The `find` here gets every directory in my home dir, one level deep, but some of them have spaces... the default 'for i in $(find ...)' behavior treats each individual word boundary as a separate variable, but piping to `read` breaks them on newlines
// Note: OS X `find` does not support "-depth 1" (its -depth opt is for depth-first searching vs. breadth-first), just use an 'ls' with an 'if [ -d $filename]' to test for directories



find ~ -type d -depth 1 | while read filename; do

# ls ~ | while read filename; do

	echo $filename

	# other stuff

done

MediaWiki LDAP configuration

jamiew (Jamie Wilkinson) — Tue, 12 Jun 2007 16:42:25 GMT

Requires the LdapAuthentication extension. Regarding precise LDAP queries YMMV.



# LDAP authentication

require_once( 'extensions/LdapAuthentication/LdapAuthentication.php' );

$wgAuth = new LdapAuthenticationPlugin();



$wgLDAPDomainNames = array( "domain-ldap" );

$wgLDAPServerNames = array( "domain-ldap" => "ldap.domain.org"  );

$wgLDAPEncryptionType = array( "domain-ldap" => "clear" );   // "testADdomain"=>"tls",

$wgLDAPSearchStrings = array( "domain-ldap"=>"uid=USER-NAME,ou=People,dc=domain,dc=org"  );



$wgLDAPWriterDN                         = array( "domain-ldap" => "cn=Manager,dc=domain,dc=org" ); // for changing passwords; AddLDAPUsers below must be true

$wgLDAPWriterPassword = array( "domain-ldap" => "MANAGERPASSWORD" ); // FIXME

$wgLDAPWriteLocation    = array( "domain-ldap" => "ou=People,dc=domain,dc=org" );



$wgLDAPAddLDAPUsers = array( "domain-ldap" => true ); // allow adding users to LDAP from mediawiki? require WriterDN/Password

$wgLDAPUpdateLDAP = array( "domain-ldap" => true );    // for updating passwords;

$wgLDAPUseLocal = array( "domain-ldap" => true ); // failover to local DB?

$wgLDAPMailPassword = array( "domain-ldap" => true ); // if can't write to LDAP this is basically useless

$wgLDAPRetrievePrefs = array( "domain-ldap" => true );

$wgMinimalPasswordLength = 1;



// Don't automatically create an account for a user if the account exists in LDAP but not in MediaWiki. Default is false.

// this totally breaks things, do not turn it on

$wgLDAPDisableAutoCreate = array( "domain-ldap" => false );



$wgLDAPDebug = 1; // 3 is a lot

vi find/replaces for adding a table prefix to a SQL dump

jamiew (Jamie Wilkinson) — Mon, 11 Jun 2007 22:00:37 GMT

Was importing a DB but wanted to prefix the tables, but the file was too large for TextMate. Here's all the vim substitutions



%s/DROP TABLE IF EXISTS `/DROP TABLE IF EXISTS `prefix_/g

%s/CREATE TABLE `/CREATE TABLE `prefix_/g

%s/INSERT INTO `/INSERT INTO `prefix_/g

%s/LOCK TABLES `/LOCK TABLES `prefix_/g

%s/ALTER TABLE `/ALTER TABLE `prefix_/g

mongrel_cluster monit script

jamiew (Jamie Wilkinson) — Mon, 11 Jun 2007 19:43:23 GMT

Copyright (C) 2006 Peter J Jones (pjones@pmade.com).

################################################################################
# This script will update your monit configuration file to monitor your
# mongrel cluster by reading the mongrel cluster file and generating monit
# check entries. It places delimiters in the configuration file so that you
# can run this script multiple times without generating duplicate entries.
#
# Run it like this:
#
# mongrel_monit --mongrel=/path/to/mongrel/config.yml --monit=/path/to/monitrc
#
# You can edit the ERB template below to control the generated monit config.
#





TEMPLATE = <check process mongrel_<%= @port %> with pidfile <%= @pidfile %>

  group mongrel

  start program = "/usr/local/bin/<%= @start %>"

  stop program = "/usr/local/bin/<%= @stop %>"



  if failed host 127.0.0.1 port <%= @port %> protocol http

    with timeout 10 seconds

    then restart



  if totalmem > 100 Mb then restart

  if cpu is greater than 60% for 2 cycles then alert

  #if cpu > 90% for 5 cycles then restart

  #if loadavg(5min) greater than 10 for 8 cycles then restart

  if 3 restarts within 5 cycles then timeout



EOT

################################################################################

require 'erb'

require 'optparse'

require 'fileutils'

require 'rubygems'

require 'mongrel_cluster/init'

################################################################################

module Kernel

  $commands = []



  # Hack Kernel::` so that we can capture what mongrel_cluster does

  def ` (cmd)

    $commands << cmd

    system(':') # to set $?

  end



  # Hack Kernel::puts to shut mongrel_cluster up

  def puts (str)

    true

  end

end

################################################################################

options = OptionParser.new



options.on('--mongrel=FILE', 'Mongrel configuration file') do |o|

  $mongrel_config = o

end



options.on('--monit=FILE', 'Monit configuration file') do |o|

  $monit_config = o

end



options.parse!



unless $mongrel_config and $monit_config

  puts "please give --mongrel and --monit"

  exit 1

end

################################################################################

mongrel_config_data = YAML.load_file($mongrel_config)

Dir.chdir(mongrel_config_data['cwd']) if mongrel_config_data['cwd']

################################################################################

# This is the only way to access the cmd that mongrel_cluster uses so that we

# can keep things DRY

start = Cluster::Start.new

start.instance_variable_set(:@config_file, $mongrel_config)

start.run

start_commands = $commands.dup

$commands.clear



stop = Cluster::Stop.new

stop.instance_variable_set(:@config_file, $mongrel_config)

stop.run

stop_commands = $commands.dup

$commands.clear

################################################################################

template = ERB.new(TEMPLATE)

config = ''



0.upto(start_commands.length - 1) do |i|

  @port = start_commands[i].match(/-p\s*(\d+)/)[1]

  @pidfile = File.expand_path(start_commands[i].match(/-P\s*(\S+)/)[1])

  @start = start_commands[i]

  @stop = stop_commands[i]

  config << template.result(binding)

end

################################################################################

monit_config_data = File.open($monit_config) {|f| f.read}



# TODO: if you have more than one cluster, this won't do

banner_start = "#= Mongrel_Monit Config Start =#\n"

banner_stop  = "#= Mongrel_Monit Config End =#\n"



if monit_config_data.match(/#{banner_start}.*#{banner_stop}/m)

  monit_config_data.sub!(/#{banner_start}.*#{banner_stop}/m, "#{banner_start}#{config}#{banner_stop}")

else

  monit_config_data << "#{banner_start}#{config}#{banner_stop}"

end



File.open($monit_config, 'w') {|f| f << monit_config_data}

################################################################################