Kurt's Weblog

#!/usr/bin/env bash
in=survey-icon-66x66.png

count=1
while [[ $count -le 9 ]]; do
    convert -fill brown -draw "circle 51,51 61,61" -fill white -pointsize 20 -annotate +46+59 $count $in survey-icon-66x66-$count.png
    let count=$count+1
done

count=10
while [[ $count -le 30 ]]; do
    convert -fill brown -draw "circle 51,51 61,61" -fill white -pointsize 20 -annotate +40+59 $count $in survey-icon-66x66-$count.png
    let count=$count+1
done

bag file, deltas     x_min    y_min    x_max    y_max
H11536_1_of_4       0.9380  -6.5251   0.1306  -7.3478
H11554_1_of_1_BAG   0.2377  -8.0011  -0.5709  -8.7929
H11555_1_of_1       0.1354  -8.1659  -0.6326  -8.9748
H11612_1_of_2     -14.7299 -16.4563 -15.6013 -17.3354

ogr2ogr -f kml survey.kml caris_survey.gml

<?xml version="1.0"?>
<smXML:MD_Metadata 
  xmlns:smXML="http://metadata.dgiwg.org/smXML"
  xmlns:xlink="http://www.w3.org/1999/xlink"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xmlns:gml="http://www.opengis.net/gml">
<!-- ... -->
  <spatialRepresentationInfo>
    <smXML:MD_Georectified>
      <cornerPoints>
        <gml:Point>
          <gml:coordinates decimal="." cs="," ts=" ">427393.74,4085752.56 433314.44,4090295.74</gml:coordinates>
        </gml:Point>
      </cornerPoints>
    </smXML:MD_Georectified>
  </spatialRepresentationInfo>
<!-- ... -->
</smXML:MD_Metadata>

#!/usr/bin/env python
import h5py
from lxml import etree 

f = h5py.File(infile_name)

bag_root = f['/BAG_root']
metadata_xml = ''.join(bag_root['metadata'])
root = etree.XML(metadata_xml.replace('smXML:','')) # Me being bad with namespaces

utm_coords = root.xpath('//*/gml:coordinates', namespaces={'gml':"http://www.opengis.net/gml"})[0].text

...
The Gunter will sail to the vicinity of the well head and begin a
systematic survey using its 18 and 38 kHz sonar to define the shape
and extent of the underwater plume. University of New Hampshire Joint
Hydrographic Center scientists onboard will explore the feasibility of
using mid-water mapping sonar to image the submerged plume in
combination with new software that could result in 3-D images of what
is happening underneath the surface.

If potential plumes are identified, the Gunter will deploy a unique
autonomous underwater vehicle provided by the Monterey Bay Aquarium
Research Institute. Called the Gulper, the vehicle will take discrete
water samples at various depths to allow precise characterization of
any oil, dispersants, or other substances in the plume.
...

Based on three separate methodologies, outlined below, the independent
analysis of the Flow Rate Technical Group has determined that the
overall best initial estimate for the lower and upper boundaries of
flow rates of oil is in the range of 12,000 and 19,000 barrels per
day.
...
On May 25, 2010, at approximately 17:30 CDT, the RITT logged oil
collection at a rate of 8,000 barrels of oil per day, as measured by a
meter whose calibration was verified by a third-party. Based on
observations of the riser, the team estimated that at least 10% of the
flow was not being captured by the riser at the time oil collection
was logged, increasing the estimate of total flow to 8,800 barrels of
oil per day. Factoring in the flow from the kink in the riser, the
RITTI Team calculated that the lower bound estimate of the total oil
flow is at least 11,000 barrels of oil per day, depending on whether
the flow through the kink is primarily gas or oil.
...

• docs: Include ESR's AIVDM.txt with permission
• docs: MID / DAC / MMSI prefixes now listed in mid.csv
• docs: dac/fi list
• docs: More notes for message designers
• Added msg 8 - 1:11 - IMO Met/Hydro
• Added AIS msg 9 - SAR Position
• nais2py.py: Added try except wrapper on ProcessingThread. Also try to track one off error found on call with timestamp converting to float
• send_data.py: new file for testing
• nais2py.py: LineQueue now has a custom drop handler for too many lines waiting. Could be better.
• nais2py.py: Added threaded network interface. Seeing the network side overwhelm the processing thread
• nais2py.py: Added response_class handling to VesselNames. Can be preloaded. Allows periodic name dump
• nais2py.py: Added ENABLE_DB flag to try runs without database execute commands. Faster debugging

• Started working on the new and separate libais C++ library for AIS with C-Python bridge for Deepwater Horizon
• Allow ais_bin_msgs.py to print out the corresponding AIVDM line
• Msgs 6 and 8 decode dac and fi
• Msg 21 fixed for ATONS to handle two new flags
• Msg 21 handcoded can now deal with the extended name
• ZNT NMEA string for NTP time quality
• ais_normalize can handle data w/out timestamps
• Add first C++ AIS code - ais_filter_by_mmsi
• In ais.binary, fixed a 2's complement bug for the lowest negative number... this was bad!
• Msg 7 had the spare as 1 bit when it should have been 2. Creating a handcoded version to deal with shorter messages
• This version corresponds to working on libais-0.1 to libais-0.2
• New INSTALL file base on report from gemiller on irc:gpsd
• NEW FILES: ais_msg_21_handcoded.py ais_msg_7_handcoded.py imo_001_11_handcoded.py
• NEW FILES: template.bash nmea_error.py znt.py ais_filter_by_mmsi.cxx ais_bin_msgs.py
• NEW FILES: ais_decimate_traffic.py ais_distance.py ais_info.py ais_nmea_find_matches.py
• NEW FILES: ais_nmea_uptime2.py ais_nmea_uscg_timeshift.py ais_pg_grid_transits.py
• NEW FILES: find_missing_logs.py logger_handlers.py serial-logger2.py

#!/usr/bin/env python
from __future__ import print_function

import traceback
import sys

def catch(func):
    'Catches any exception and prints a stack trace.'
    def wrapper(*args,**kwargs):
        try:
            return func(*args,**kwargs)
        except:
            print ('Caught exception')
            traceback.print_exc()
    return wrapper

@catch
def face_palm():
    int("a")

face_palm()
print ('still running')

Processes: 119 total, 3 running, 1 stuck, 115 sleeping, 402 threads                                                       14:10:00
Load Avg: 0.31, 0.23, 0.21  CPU usage: 1.54% user, 0.66% sys, 97.78% idle  SharedLibs: 6656K resident, 7072K data, 0B linkedit.

PID    COMMAND      %CPU TIME     #TH   #WQ  #POR #MREG RPRVT  RSHRD  RSIZE  VPRVT  VSIZE  PGRP  PPID  STATE    UID  FAULTS
3670-  python2.6    12.2 01:03.75 3/1   0    40   156   13M+   1672K  15M+   90M    663M   3670  234   running  501  4536+
3671-  postgres     1.0  00:07.86 1     0    9    63    988K   13M    7756K+ 1212K  604M   3671  43481 sleeping 252  2098+
3632-  Qgis         0.2  00:13.95 2     1    101- 512-  41M-   56M    76M-   123M-  1120M- 3632  173   sleeping 501  42320 
...

CREATE TABLE vessel_pos (
       mmsi INTEGER PRIMARY KEY,
       cog INTEGER,
       sog REAL,
       time_stamp TIMESTAMP WITH TIME ZONE DEFAULT now(),
       nav_status VARCHAR(30) -- convert the code to a string for presentation
       ) WITH OIDS;
SELECT AddGeometryColumn('vessel_pos','pos',4326,'POINT',2);
SELECT AddGeometryColumn('vessel_pos','track',4326,'LINESTRING',2);

-- CREATE INDEX vessel_pos_pkey ON vessel_pos(mmsi); -- created automatically if done through psql
CREATE INDEX vessel_pos_ts_idx ON vessel_pos(time_stamp);

CREATE TABLE vessel_name (
       mmsi INTEGER PRIMARY KEY,
       name VARCHAR(25), -- only need 20
       type_and_cargo INTEGER,
       response_class INTEGER -- 0 do not display differently.  1 == response vessel
);

-- CREATE INDEX vessel_name_pkey ON vessel_name(mmsi); -- created automatically
CREATE INDEX vessel_name_rc_idx ON vessel_name(response_class);

mmsi = 36898800 name: ALTAIR

python(9483,0xa0ae34e0) malloc: *** mmap(size=262144) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
python(9483,0xa0ae34e0) malloc: *** mmap(size=262144) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
Traceback (most recent call last):
  File "./ais2pg.py", line 233, in 
    match = uscg_ais_nmea_regex.search(line).groupdict()
python(9483,0xa0ae34e0) malloc: *** mmap(size=262144) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
MemoryError