Main

November 16, 2007

16. November 2007 -- Freitag

On Call

  • 0135: monitoring system down page -- false alarm

Admin

  • Backup: reset authorization parameters because previous instructions munged them.
  • LDAP: provide new rpm's to mail gateway machines
  • Babysit the servers for the first-year's registration time
  • FileServers -- filesystem clearing

WoW

  • Getting to high levels of fishing skill can cause twitches!

November 15, 2007

15. November 2007 -- Donnerstag

On Call

  • webfarm problem
  • fileserver space issues

Activity Log

  • Backup -- COMIS work
  • LDAP -- DOS vector

October 8, 2007

8. Oktober 2007 -- Montag

Admin

  • Backup: TLS drive7 three flashing leds problem -- wound up rebooting storage node to clear all residual problems
  • Backup: EMC 20292396: provide the ulimit -a and truss output requested to show that the memory issue is not real in this recover 7.3.3 on aix problem
  • Backup: Work on cloning script
  • Backup: Start manual cloning of one save group that failed to clone over the weekend

On Call

  • All Quiet on the pager front

October 7, 2007

7. Oktober 2007 -- Sunntag

On Call

  • In-MailGW critical
  • /rack5d space

October 6, 2007

6. Oktober 2007 -- Samstag

On Call

  • Temporary HDISK error
  • In-MailGW critical -- three times

January 24, 2007

24. Januar 2007 -- Mittwoch

Admin

  • Blog:
    • Replaced the "mt/mt.cgi" file with a simple perl script to basically say "hello" and it still fails -- it has to be an Apache problem
  • virusscan: Updated to have DCE credentials
  • CMD FP Issue -- student with lost iMovieProject
  • DHCP/DNS config for echo

On-Call

  • LDAP: catcard system is being upgraded and delivered a 0 entry file which caused all id card values to be wiped from LDAP. Went back to yesterday's file and restored them. --- 3.5 hours CTE

January 23, 2007

23. Januar 2007 -- Dienstag

Admin

  • New Blog... yippee!
  • shutdown old (now unused) gameserver
  • Reseat blade 10 to clear a spurious memory error!
  • Set up console for last web server
  • Blog:
    • make backup of the OLD server entries
    • delete my blog
    • create a new blog for me
    • Same Internal Error going to log in page! :(
  • Listserv move ... dns and mail routing changes: CTE 1.5 hours

On-Call

October 7, 2006

7. Oktober 2006 -- Samstag

Admin

  • LDAP: logic error in dealing with null (empty/missing) titles from PeopleSoft
  • Calendar: unidbfix and up2date
    • up2date took 30 minutes
    • unidbfix process took three (3) hours

OnCall

  • only pages were that one of the in-mailgw machines had a high load

July 31, 2006

31. Juli 2006 -- Montag

Admin

  • EchoVermont.org -- web server switch
  • Accounts -- Another account that has the password encoded wrong
  • Accounts -- Audit finds 8 other accounts with similar problem... fixed
  • Accounts: dcecp replacement scripts
    • deactivate_account
    • reactivate_account
    • set_expdate_account

On Call

  • cat301 - nuisance pages (flapping)
  • copperhead - ipf failure
  • groundhog/ldap - disk filled up

July 11, 2006

11. Juli 2006 -- Dienstag

Admin

  • Three new echovermont.org virtuser entries created
  • Request for quote sent to BlackBox.com for part CBCA197370
  • Argue with Oracle about three of the four open SR's...
    • 5579086.993 - Affine encryption
      • Oracle requests that the server be modified to not require encryption...
      • YEAH, RIGHT. NOT!!!!
    • 5584043.993 - Suggest Date/Time broken on Mac client
      • Oracle says this is bug 5382125 and will be fixed in client version 10.1.3
      • The bug doesn't show up in searches and no time given for when 10.1.3 will be released
      • Oracle says the bug is visible now but no word on when 10.1.3 will be released
      • I still can't find the bug by doing a search based on the bug number...
    • 5580865.992 - universion generates garbage files in .../ocal/bin
      • Oracle says this is a known issue in the 9.0.4 server and is fixed in 10.1.2
      • What's the bug number?
      • Oracle says they can't tell me because it was reported by a different customer and therefore is confidential
  • Open issue 2600 in CATalyst Issue Log to determine what the Affiliation "PUA" means
    • CATalyst redirects the issue to HR
  • Update the PeopleSoft_Engine.pl module to complain when Affiliations without translations are found
  • Transfer the PeopleSoft_Engine.pl module update to the IdM Separation project version

On Call

  • 0238: 6 nsrexecd's running on a backup server -- nagios configured for 2-4, more or less is a critical error
    • Why?
    • Hmmm... discussion results in reconfiguration for warnings and only critical (page) if less than 1 or more than 25 are running

July 5, 2006

2. Juli 2006 -- Sonntag

Admin

  • account removals finished at 2am
  • Manually run the AD update script
  • discover a bug in the code, fix it and run the AD update script again

On Call

  • cat400 filesystem filled up at 11:38
    • Unable to get a response on the CATalyst pager
    • Tried a CATalyst team member directly -- no response
    • Called CATalyst team lead at home
    • Followed directions of team lead to
      1. Disable the paging
      2. Send a note to the CATalyst team explaining the problem and ask that they clean up the filesystem
  • rmxcreds segfault 11 at 5:50am Monday morning -- no clue about problem -- no repeat performance

1. Juli 2006 -- Samstag

Admin

  • Remove accounts 6377
  • Discover that HR is renaming departments again... open Footprints ISSUE=2484 PROJ=36

On-Call

  • No activity