GEM FAQ and Change Log

GEM Documentation Navigation Page. Documentation is also available at The GEM Home Page. Documentation and Code are both Copyright © 1995-2006 by Sql Technologies. All Rights are Reserved.

The Complete GEM Documentation Slide Show: What Is GEM Download GEM
 
An Introduction To GEM How To Install Getting Started Guide
Batch Jobs Overview GEM Screenshots Server Backup and Maintenance
Utilities Guide The GEM Console New System Stored Procedures
FAQ and Change Log Common Perl Libraries Pricing & Right To Use

CHANGE LOG

List of changes

DESCRIPTION

This file lists known bugs and contains the latest release notes, create dynamically by our source code control system.

MAJOR OUTSTANDING ISSUES

None known

MINOR OUTSTANDING ISSUES

 * doesn't check alarm db prerequesits (like truncate log on checkpoint...)
 * troubleshoot is still a bit sloppy
 * Installer does put stuff in your web server cgi-bin
 * historical server reporter packaged separately
 * monitor lacks drill down and integrated windows perfmon
 * oracle
 * unix logs need be set up manually.  recommend central syslogd

Fixed Bugs

Build 704 (Apr 9 2008)

Build 703 (Apr 9 2008) ROllup Release. Lots of doc changes. Oteher stuff too.

Build 702 (Mar 18 2008) documentation on batch jbos

Build 701 (Mar 14 2008) another release

Build 700 (Feb 7 2008) backup scripts updated

Build 699 (Nov 14 2007) doc updates for procs & backups srcripts

Build 698 (Nov 12 2007) Another RRelease

Build 697 (Nov 11 2007) LATEST & GREATEST BETA

Build 696 (Nov 7 2007) user interface changes - freegem ssh/rsh/ftp toggles etc

Build 695 (Nov 1 2007) FONT FIX FOR LARGER DEISPLAYS

Build 694 (Oct 23 2007)

Build 693 (Oct 23 2007) FULL VERSION TR

Build 692 (Oct 1 2007) Lots of minor things - too numerous to remember

Build 690 (Jun 20 2007) Lots of misc cleanup - i need to keep better notes

Build 689 (May 29 2007) Release Build

Build 688 (May 15 2007) Variety of upgrades focused on data collection and logging

Build 687 (Mar 30 2007) New Upload release

Build 686 (Mar 17 2007) Rollup Release

Build 685 (Dec 22 2006) might as well release something

Build 684 (Dec 14 2006) ROLLUP RELEASE - SEE LATEST_NEWS

Build 683 (Dec 5 2006) Major Release - See To Do List

Build 682 (Nov 1 2006) November Port For Linux - Try #1

Build 681 (Sep 25 2006) rollup release

Build 680 (Sep 12 2006) Sqlsvr sp__dbspace update, documentation

Build 679 (Sep 8 2006) many. sql audits werent working. multiple minor fixes.

Build 678 (Aug 25 2006) Rollup Release - Minor Tweaks & Doc Fixes

Build 677 (Aug 3 2006) Final Pre Techwave Build (???)

Build 676 (Aug 1 2006) MLpReports.pm was calling MlpAlarms too soon...

Build 675 (Aug 1 2006) Removed extraneous DBG DBG prints from old diagnostic messages

Build 674 (Aug 1 2006) osql/isql check on configure.pl startup now reflects db picklist appropriately

Build 673 (Aug 1 2006) New Reports & Report Manager, New screen for reports on configure.pl

Build 672 (Jul 24 2006) Continuing console cleanup

Build 671 (Jul 22 2006) Significant Console Cleanup for consistency

Build 670 (Jul 13 2006) SQL Server Only Build - Removed dies for $SYBASE, Tightened Prints & Error Messages

Build 669 (Jul 13 2006) Added Server Type Checkboxes to Configure.pl & Console

Build 668 (Jul 6 2006) Failed the last build

Build 667 (Jul 6 2006) Threshold Report/Frag Report on Console werent displaying right

Build 666 (Jun 13 2006) RELEASE VERSION

Build 665 (Jun 13 2006) Prep for Release Beta2

Build 664 (Jun 9 2006) minor revisions - working on hourglass consistency

Build 663 (Jun 8 2006) Moved configure.pl to one RegisterServer() and made console header changes for clarity

Build 662 (Jun 7 2006) working on autodetection...

Build 661 (Jun 6 2006) Full build - apparently some of the libs were not passed correctly to subshells

Build 660 (Jun 6 2006) Updated Rep Monitoring, Updated Batch Script/Console Documentation

Build 659 (Jun 1 2006) Release version - fixed up some gotchas in unix-autodetect (was leaving comm path as SSH even if it could only get to the system via FTP)

Build 658 (May 31 2006) Rotate Large Files, Do_RSH has better quoting, port_monitor.pl is signlethreaded by default

Build 657 (May 30 2006) more none...

Build 656 (May 30 2006) none

Build 655 (May 30 2006) no notes

Build 654 (May 23 2006) errr... aborted the last one - same - minor perl -w cleanup, fixed win32 configure.pl freezeups

Build 653 (May 23 2006) perl -w testing. win32 configure.pl freezeups fixed

Build 652 (May 18 2006) mod to autogen purge_files cfg files, sample cfg file redocumented

Build 651 (May 17 2006) Final Alarms Screen Work, Updated Replication Monitor to better handle multiple rep servers

Build 650 (May 16 2006) Some bug fixes in initial surveys to deal with multiple external SYBASE directories

Build 649 (May 12 2006) added $SYBASE predefineds to surveys, more maint plan stuff

Build 648 (May 11 2006) Plan Wizard Logic Added

Build 647 (May 5 2006) Major Release

Build 646 (May 4 2006) if SSH fails in configure.pl wizard - it trys FTP mode

Build 645 (May 3 2006) Massive checks that METHOD is appropriately used in myFTP

Build 644 (May 3 2006) CommonHeader.pm syntax error, removed junk docs

Build 643 (May 3 2006) added dont_skip button

Build 642 (May 3 2006) Auto Sybase Env in CommonHeader.pm, Version Report Updated, Handles Multiple Tempdb's better, Custom Titles in cgi-script, New cgi-script build process

Build 641 (May 1 2006) bunch of minor stuff - not sure what

Build 640 (Apr 27 2006) backup updates, bug fixes, puttering

Build 639 (Apr 19 2006) updated backup docs, reorg moved before updstats, troubleshoot.pl halfway ported to gui mode (its broken now tho)

Build 638 (Apr 17 2006) Added InstallState File To Clean Errors 

Build 637 (Apr 17 2006) Update docs (pricing). Depricate --OVERRIDE. Add Facilities for Install State

Build 636 (Apr 13 2006) Updated configure.pl to make a better console plus minor stuff

Build 635 (Apr 12 2006) Added DUMP_FILES_PER_SUBDIR option to backup.pl/dump-database.pl/load_datbase.pl

Build 634 (Apr 10 2006) MDA procs update / pod update for these procs

Build 633 (Apr 7 2006) 2 syntax errors in backup.pl

Build 632 (Apr 7 2006) Build and Copy Console added to configure.pl

Build 631 (Apr 7 2006) Print Handlers added to myFTP and do_rsh

Build 630 (Apr 7 2006) Some Win32 Stuff Ended Up Running in Unix Only Build

Build 629 (Apr 6 2006) Another Test Release - AM/PM fix within load_all_tranlogs.pl (was giving spurious error messages)

Build 628 (Apr 6 2006) Test Version

Build 627 (Apr 4 2006) bug fix to ssh code

Build 626 (Apr 4 2006) SSH features added

Build 625 (Mar 20 2006) renamed nt_batch_scripts to win32_batch_scripts

Build 624 (Mar 17 2006) Console Update - Broke it up into clearer batch jobs

Build 623 (Feb 21 2006) added perlargs env variable. Modified ping for linux versions

Build 622 (Feb 17 2006) reorg_rebuild.pl optdiag_analyze.pl mssql_attachscript.pl minor mods

Build 621 (Feb 14 2006)

Build 620 (Feb 14 2006) oopsie rebuilding configure.pl

Build 619 (Feb 14 2006) Updated thresholds_overrides.dat

Build 618 (Feb 8 2006) Backup Script Documentation, ping_systems.pl only alarms if reping fails, tracert.pl minor formatting

Build 617 (Feb 2 2006) 2 more updates to monitor.pl, df -k changed to df -kl

Build 616 (Feb 2 2006) update to monitor.pl, update blackout reports

Build 615 (Jan 23 2006) none

Build 614 (Jan 23 2006) none

Build 613 (Jan 20 2006) console changes; threshold manager; port monitor generator; stored proc changes

Build 612 (Jan 13 2006) pass on wizard for installs - removing messages. nothing big

Build 611 (Jan 9 2006) Test For Full Release. COnsole Changes. Audit Changes.

Build 610 (Dec 21 2005) yes its build 610

Build 609 (Dec 13 2005) full installer unit test

Build 608 (Dec 10 2005) Mostly Done - All But The Plan Manager Reverse Engineering

Build 607 (Dec 8 2005) again

Build 606 (Dec 8 2005) oops - needed a tarbal

Build 605 (Dec 8 2005) more bug fixes

Build 604 (Dec 6 2005) Almost Done...

Build 603 (Dec 5 2005) More minor configure.pl updates

Build 602 (Nov 30 2005) Updates to the configuration utility

Build 601 (Nov 22 2005) disabled buttons, new browser buttons for the configuration utility

Build 600 (Nov 18 2005) updated runcommand to a window. broke out post-configure tasks in configure.lp

Build 599 (Nov 10 2005) troubleshoot.pl rewrite

Build 598 (Nov 4 2005) A few new reports and fixed logshipping full db resync

Build 597 (Nov 3 2005) updated docs. worked on configure.pl.

Build 596 (Nov 2 2005) Add Server Wizard

Build 595 (Oct 28 2005) rename mlpalarms to gemalarms. fixed 2 batch jobs. added 2 new batch jobs

Build 594 (Oct 27 2005) forgot 2 batch jobs, sql svr stored proc mods

Build 593 (Oct 19 2005) upgrade.pl working and tested

Build 592 (Oct 19 2005) Proc Lib Mods for Win32, 3 New Console Reports, Sys15 finished?

Build 591 (Oct 14 2005) internals in configure.pl for backup_plan simplification

Build 590 (Oct 13 2005) Final Testing Completed on System 15 - procs and alarm installer (probably need to do a full test on it but thats for later)

Build 589 (Oct 12 2005) Phew... more and more documentation! pass 1 of the doc is done

Build 588 (Oct 7 2005) New Standard GEM Reports, very minor look and feel tweaks

Build 587 (Oct 5 2005) Documentation Upgrade

Build 586 (Sep 30 2005) minor pg1 doc changes for configure.pl

Build 585 (Sep 30 2005) PcCleanup made hourly; Post Install Tasks Doc Mod; Text change for Scheduled Task Manager

Build 584 (Sep 29 2005) Updated Unix Log FIle Monitor

Build 583 (Sep 23 2005) Documentation Bundle, Rep Server Screens Redone, Mostly a repackaging for shipping to the web site

Build 582 (Sep 21 2005) system 15 modifications for Extended Stored Procedure Library

Build 581 (Sep 19 2005) minor chg to a few reports, replication monitoring

Build 580 (Sep 9 2005) FINAL VERSION FOR HOME TESTING

Build 579 (Sep 8 2005) Test Version For Full Release! Console changes, Server Registration. Docs.

Build 578 (Sep 2 2005) Pre Final - Redoing Server Entry Screens, Sybase Replication

Build 577 (Aug 27 2005) pre vacation. console changes. working on data entry

Build 576 (Aug 22 2005) Updated Console Reports (major upgrade). Many minor edits.

Build 575 (Aug 1 2005) August Distribution

Build 574 (Aug 1 2005) Final Backup Tab Changes, Minor weekend tweaks

Build 573 (Jul 31 2005) UPgrade Documentation - console changes - finishing backup tab on config Jcombobox

Build 572 (Jun 14 2005) Update of Console Layout, Directory Structure Changes, Minor Fixes

Build 571 (May 29 2005) Version for Release - Full Beta 1

Build 570 (May 26 2005) crontab creation mods for clarity

Build 569 (May 21 2005) Test unix and windows install - modified a few cosmetics

Build 568 (May 19 2005) Retest Unix Installer; Updated Documentation; Javascript Console Menus

Build 553

 * update the files tab to be clearer - save the files information into xml in better format
 * Setup.pl - needs a check on Win32 perl if you are on samba - but i dont do it
 * fix the fonts so stuff is readable - make them user defined
 * Add SQL Servers to Auto Documentation Schema
 * how wierd... wrong sa password works fine for odbc sql server connections.  Guess windows networking
   is used by default.  hmmm....
 * use the internal connection for the stored procedure library installer instead of osql.  Fact is... trusted
   connections work.
   move configure.pl for procs into a library
   add $* to .ksh interactive scripts
   Separate Validation and Installation Tabs
      - validation should have step by step validation
   Test Each button press in configure.pl
   Validate Alarm Installation Unimplemented

Build 552

 * whole list of configure.pl cosmetic fixes.
 * win32 version freezes when you expand the friggin databases (click on plus)  need my debugger

Build 543

 * blocked process monitor was failing to detect log suspend
 * better mimi install
 * Worked on Win32 Batch scripts

Build 541

 * setup process will build empty directories - apparently winzip does not create them
 * worked on documentation
 * integrated RosettaStone.pm
 * refresh explorer colors to reflect connection status
 * modified maint plans plugin - expanded navigator name and added rtclicks
 * modified the monitoring plugin to remove bug that occurred when you changed pages

Build 540 This release is the "porting release". I have attempted to run the *same* code line under multiple windows and unix boxes using multiple versions of perl. There were a several nightmares with Tk libraries causing freeze ups - and what i learned is that there is tight coupling between the versioning of the Tk add on libraries. This means that you cant just add perl modules like i had been doing and expect it to work every time every where. The solution is to require a reasonably recent version of Tk.pm to be installed so i dont need to provide the missing functionality. To summarize, i am removing the dependencies on perl and adding a dependency on your having a somewhat recent version of Tk.

I also had to remove some features that were screwing things up. Specifically, i removed the Bitmap images that were on the top left of the page. They were nice and allowed future features to be put in as image clicks, but unneeded since the buttons were not tied to anything useful.

 * worked on right clicks some more

Build 539

 * turn off stdout prints - save instead to log file (it freees screen)
 * test the servers on the validation page of configure.pl
 * search and remove print statements - replace with _statusmsg()
 * prefetch DBI DSNs
 * remove choice of DSN for servers -> auto choose and require odbc
 * remove std output prints unless ur talking debug or god mode

Build 537

 * rebuild of installer and testing
 * sp__stat2 prints error in procs/configure.pl
 * menuitems seem to function ok
 * added mda table viewing for ASE
 * need hourglass for busy
 * added Win32 and unix html viewing
 * helpdbdev - was incorrectly formatting

Build 536

 * sp__lock page number not fitting in char(8) field
   Msg 265, Level 16, State 1
   Server 'IMAGSYB1', Procedure 'sp__lock', Line 82
   Insufficient result space for explicit conversion of INT value '106949706' to a CHAR field.
 * need a run_cmd module that works interactively instead of freezing TK
 * finished download capability for plugins
 * colorize the servers in explorer window
 * Added Copyright Notice
 * minor mod to sqlsvr sp__whodo
 * added error handling to rtclick

Build 535

 * check adjustment of Mlpalarm.pm based on config falues
 * rebuild configure.pl
 * Cant install sql server stuff from unix (of course) - annotate
 * make a survey/discover function that works from setup better and shows result
 * rearchitected surveys
 * use connectionmanager in configure.pl
 * added RunCommand module
 * added sp__helpdb for sql server
 * added event model
 * modified backup scripts for -J options on a few other things
 * configure.pl for procedures seems to print use and dump statements

Build 534

 * Added File Tab to configure.pl

Build 532

 * Finish Backups Tab
 * reinvented cron jobs yet again
 * modified some code so dynamic repathing validation works better
 * add config screens cross tools so configure.pl is in gem.pl etc...
 * if NT the use ODBC, if Unix then Use Sybase... its that simple
 * Numerous fixes to a variety of things.
 * Integration of configure.pl and gem.pl
 * Color Coded Tree
 * Worked on Monitoring and Backups Plugin

Build 531

 * build nt_local_scripts and unix_local_scripts correctly
 * fix translator for read_configfile to handle things correctly
 * dual perl includes - so it works both nt and unix
 * Finalize the configure.pl
 * dual environment stuff for shared Unix/Nt  on samba drives

Build 530

 * Mondified monitor_appslog to use File::Tail instead of File::Multitail

Build 529 (Sep 7 2005)

 * modified version string in gem.pl - was showing wrong.
 * several integration changes
 * removed all Win32 calls from bin/gem.pl - they were getting called even
   though they were in an eval block
 * Changed error message when creating crontab with bad file structure.
 * Added dist subdirectory to the conf subdirectory for raw files (saved)
 * documenter - changed default output destination to data/DAILY_REPORTS
 * change lock file location to data/lockfiles in CommonFunc.pm

Build 528 (Sep 7 2005)

 * Final Alpha Cleanup
 * MlpAlarms.pm has hard coded server in it
 * Significant FInal Cleanup
 * Add Mlpalarms to screen
 * Test Brand New Install
 * Use CONFIG{SYBASE} instead of $SYBASE

Build 526: Tue Jun 12 10:38:52 EDT 2001

    remote symlinks for directories now supported better.  Logdumps were not
      being purged when the directory was a symlink because the ftp fspec
      would return the symlink info not the info on the directory contents.
Build 526: Mon Jun 4 10:42:59 EDT 2001
    changed #BEIGE to BEIGE so odd colors not showing up in reports
    modifed config_report.pl so that image data from syscharsets not dumped
    added bin/newsuid.pl program to change suids on a server
    removed underscores in titles on documenter reports
Build 306: Fri May 25 14:49:46 EDT 2001
    modified server documenter look and feel
    modified config report to add some new tables to those being selected
Build 305: Tue Mar 27 16:09:26 EST 2001
    modified backup procedures to enhance hot backups via ftp
    modified several server documenter reports (minor)
Build 304: Wed Feb 21 16:13:48 EST 2001
    modified procedures.pl - was not taking DDL reports database as argument
Build 303: Tue Feb 20 12:16:00 EST 2001
    modified helpdb - for some reason status2&0x01=0x01 does not work where
       status2&1=1 does....  this inaccuratly showed some db options
Build 302: Tue Feb 13 13:42:49 EST 2001
    Modified troubleshoot.pl to change order of includes and to remove
       TERM::ANSIColor
Build 301: Thu Feb 8 12:35:21 EST 2001
    dbcc checker - reverse order of days shown
    core dump checker - summary report at end
    modified width of non formated sp__diskdevice - somehow it got>80 characters
Build 293
    fixed format of dbcc checker
    added check for login without legit def db
Build 292
    added dbcc checker
Build 291 Mon Jan 29 14:24:02 EST 2001
    Much cleanup on webmonitor screens
    added test for logins without default database
Build 289 Tue Jan 23 10:16:46 EST 2001
    renamed rsh_run_cmd.pl to run_cmd_on_all_hosts.pl
    modified messages for configuration problems with backup scripts
    added -o option for dbcc - output directory for raw output
    timestamped remote agent messages (remote_agent.pl)
    modified format on webmonitor procedures.pl screen
    modified version identification in webmonitor
    fixed webmonitor backup screen
    fixed debugging comment for greyed out buttons in webmonitor
    fixed problem ftping on nt servers (pwd() function in myFTP.pm)
    modified webmonitor screen selection for default users
    modified monitor screen comments when remote_agent is not up
    modified badindex stored procedure - changed defn of bad index to 90 bytes
    put $^X stmts into document_all.pl - there was a problem on pc's without it
    modified startup comment in dbcompare.pl utilitiy
    modified check_sybase_for_blocks for cleanliness of output
    modified format on configure screen
    added in sh.exe - a nt /bin/sh (had been omitted accidentally from release)

Sat Jan 20 15:53:28 EST 2001

    modified server documenter for pc environment - put $^X so interpreter
      can deal etc...
    myFTP.pm modified for pwd() for local host (needed on pc's).

Fri Jan 19 10:31:12 EST 2001

    broke sym link checker into separate report from
    added mail report to server_documenter
    added crontab report to server_documenter
    changed rdist/rsh_run_cmd.pl - had backwards logic for RSH_OK test
    modified space error report to make prettier

Thu Jan 18 11:38:38 EST 2001

    removed rule in debug_one_server.pl regarding select into being on if
           data and log on same device
    fixed bad link on main html page
    added copy_syslogins.pl
    modified core_dump_checker.pl to format page top according to doc standards
          and to report date in a <PRE> block.  Also report bad symlinks.

Wed Nov 28 17:38:31 EST 2001

    Changed sybfunc for table defn error

Tue Feb 5 14:51:17 EST 2002

    Worked On dependency analyzer

Thu Feb 14 11:56:07 EST 2002

    Added First 100 Rows to extracter

Thu Mar 7 14:24:33 EST 2002

    Changed sp__helpcolumn so that decimals printed ok

Wed Mar 13 20:45:57 EST 2002

 Multitude of install simplifications for the bad values in the config
      file situations.
    changed rev_db to output additional space between end and go.
 changed sp_addalias to remove aliases in model
 removed update stats bad message from

Wed Apr 16 11:50:45 EDT 2003

    added sybase vbl as parameter on documenter jobs
    moved custom .dat to main directory
    custom reports dying dont abort server documenter now
    modified sp__block for very large blocked times (in the days)
    documentation changes

Fri May 16 10:04:14 EDT 2003

    added monitoring software monitord.pl/monitor.pl

Thu May 29 08:49:45 EDT 2003

 removed sybsystemdb from the list of 10011 error db's (data&log on same device)

Mon Jun 23 08:40:03 EDT 2003

    modified nightly/weekly/hourly batches to require sybase environment
    variable to be set.

FREQUENTLY ASKED QUESTIONS

DESCRIPTION

q) i just want to install your stored procedure library... what should i do.

a) just go to the ADMIN_SCRIPTS/procs subdirectory and run /configure.pl.

   The main issue you will in counter with this perl script is your perl setup and
   your perl library path.  If you get missing module messages it is likely that this
   is the problem.  The script uses the GEM library DBIFunc.pm, which is located in the
   lib directory.  The configure.pl script should find it automatically, if it does not,
   please contact SQL Technologies.  configure.pl will prompt you for Server, Login (an
   sa login) and Password - it will then autodetect if you are on Microsoft SQL Server
   or Sybase and install the procedures as appropriate.

q) i cant run "perl configure.pl" or "perl gem.pl" to start the application.

a) Well... thats pretty general... i would love some more information. The first thing

   to do is run "perl troubleshoot.pl".

q) i want my data subdirectory to exist somewhere besides data...

a) use symbolic links. There are currently dependencies on the path to this directory

   that are not completely flexible - hence the lack of a GemRpt_DATA_DIR configuration
   variable in configure.cfg.  This may change in future versions.

q) i wish to run from unix

a) this is an x windows application from windows - you need to set your display and have an x emulator like exceed running on your pc.

   export DISPLAY=10.5.103.51:0.0
   /usr/local/bin/perl-5.8.1 gem.pl

q) the screen freezes when running some commands

a) check the background screen, the screen you called the GEM or configure.pl programs from, for output.

   the lack of fork() functionality on Windows implies that sometimes there are issues like this.  It is
   being worked.  The solution to this is often to just hit return a few times in the background screen.

q) i get an error that looks like:

 >> [gem.pl]    | Reading XML Configuration File - conf/
 >> [gem.pl]    | Reading Gem Function Library
 >> [gem.pl]    | Reading Configuration Files
 no element found at line 1, column 0, byte 0 at G:/dev/lib/XML/Parser.pm line 168
 <Hit Enter Key To Continue>

a) well your conf/gem.xml file is incorrect - i would just go to an archive. The archive files are all listed with date extensions in the same directory. The xml configuration file is very touchy about syntax.

q) i get the following message at startup

  junk after document element at line 6050, column 0, byte 933251 at C:/Perl/site/
  lib/XML/Parser.pm line 168
  <Hit Enter Key To Continue>

a) you have a screwed up xml configuration file. The above file is screwed up at line 6050. You will need to edit the file and fix it or to roll back to one of the dated backups.

q) why dont some of the perl scripts run stand alone???

 for example i run <i>perl fix_db.pl -AX</i> and i get

  Can't locate Repository.pm in @INC (@INC contains:
     /apps/sybmon/perl/lib/5.8.4/sun4-solaris-thread-multi
     /apps/sybmon/perl/lib/5.8.4
     /apps/sybmon/perl/lib/site_perl/5.8.4/sun4-solaris-thread-multi
     /apps/sybmon/perl/lib/site_perl/5.8.4
     /apps/sybmon/perl/lib/site_perl .) at fix_db.pl line 21.
BEGIN failed--compilation aborted at fix_db.pl line 21.

a) GEM libraries in perl are NOT stored in the normal perl library locations. They are stored in the lib subdirectory of the GEM install. If you installed into /apps/sybmon, you need to run perl -I/apps/sybmon/lib fix_db.pl -AX

To get around this problem, we use lines like

   use lib qw(/apps/gem/lib);

Which are touched / updated by the GEM Configuration Utility when you run the reformatter option.

q) I keep getting these pop up screens from my scheduled tasks

a) run your windows scheduled tasks using a different account from your interactive account.

q) My windows graphical application gets stuck/frozen

a) this is one of those silly windows'isms. If you have tabbed into the console window and scrolled, the application can get frozen. Of course, all the information (plus more) that you see in this window is actually saved into the log file and can be viewed from there. HIT RETURN IN YOUR CONSOLE WINDOW TO CONTINUE.

q) I have a problem installing... help!!!

a) well... im sorry to hear that... but the right thing to do is report it to sql technologies and to attach the log file to your error report. This file is the application name with a .log extension - so configure.log is the configure.pl log file. This log file does contain lots of details on your install and should hopefully help us solve your problem. Thanks!

q) Rep Server Error Log Contains:

E. 2006/04/25 12:04:04. ERROR #14024 USER(sa) - /execint.c(1038) Executor does not allow the entered command in the current mode.

a) Sadly, this appears to be intrinsic to the DBD::Sybase library. It must do some under the covers sql commands to verify the connection. This message means a "normal" sql command was sent to the rep server - which of course will not handle it because the rep server has no sql language handler. Ignore the messages.

q) i keep getting messages "no statement executing at ...."

a) this comes from older versions of DBD::Sybase and has been fixed in the latest version. Ignore the messages or upgrade

q) ok i scheduled all these jobs - what if something goes wrong?

a) the console contains the contents of all your log files! Basically the jobs in your crontab all use a similar syntax to :

  $ cat TraceRoute.ksh
  umask 000
  /apps/sybmon/perl/bin/perl /apps/sybmon/dev/ADMIN_SCRIPTS/monitoring/tracert.pl -BATCH_ID=TraceRoute $* > /apps/sybmon/dev/data/GEM_BATCHJOB_LOGS/Unix_TraceRoute.log 2> /apps/sybmon/dev/data/batchjob_errors/Unix_TraceRoute.log

Of course this is all customized ... the perl, the file locations etc...

So how do you see what happened!!! just look at the console under "GEM Logs" -> "BATCH FILE EXECUTION LOGS". Do this every few days to make sure things are working (or whenever you notice a problem.o

q) when i install the stored procedure library, i get language mismatch messages like :

   Msg 2401, Level 11, State 2:
   Server 'CALYPSODB':
   Character set conversion is not available between client character set 'utf8'
   and server character set 'iso_1'.
   No conversions will be done.

a) set the LANG environment variable as appropriate

   export LANG=C

q) I run GEM under LINUX and get expat errors:

   Generic Enterprise Manager Configuration Utility
   Copyright (c) 1995-2006 by SQL Technologies
   Root Directory: /apps/sybmon/gem
   Installation Log File: logs/upgrade_part1.log
   >> [configure] | Reading GEM Function Library
   >> [func]      | Reading Configuration Files - FULL
   >> [func]      | creating conf/configure.cfg from sample file
   ...
   >> [func]      | creating conf/port_monitor.dat from sample file
   >> [func]      | creating conf/replication.dat from sample file
   >> [func]      | Reading XML Data - gem.xml
   Can't load '/apps/sybmon/lib/auto/XML/Parser/Expat/Expat.so' for module XML::Parser::Expat: libexpat.so.1: cannot open shared object file: No such file or directory at /apps/perl/linux/perl-5.8.2/lib/5.8.2/i686-linux/DynaLoader.pm line 229.
    at /apps/sybmon/lib/XML/Parser.pm line 14
   Compilation failed in require at /apps/sybmon/lib/XML/Parser.pm line 14.
   BEGIN failed--compilation aborted at /apps/sybmon/lib/XML/Parser.pm line 18.
   Compilation failed in require at /apps/sybmon/gem/lib/XML/Simple.pm line 224.
   /apps/perl/linux/perl-5.8.2/bin/perl  -I/apps/sybmon/gem/lib -I/apps/sybmon/lib  /apps/sybmon/gem/bin/configure.pl --LOGFILE=logs/upgrade_part2.log --UPGRADE

a) Apparently the default linux /usr/local/lib/libexpat.a is an old version & is missing a symbol resulting in

Can't load '/apps/sybmon/DOWNLOADS/XML-Parser-2.34/blib/arch/auto/XML/Parser/Expat/Expat.so' for module XML::Parser::Expat: /apps/sybmon/DOWNLOADS/XML-Parser-2.34/blib/arch/auto/XML/Parser/Expat/Expat.so: undefined symbol: XML_SetEntityDeclHandler at /apps/perl/linux/perl-5.8.2/lib/5.8.2/i686-linux/DynaLoader.pm line 229.

You will need to build by hand. Download and install the newest libexpat.a which comes from sourceforge at http://sourceforge.net/projects/expat => I downloaded it into /apps/sybmon/DOWNLOADS/expat-2.0.0

You will want to build an all 32 bit solution. I have had no luck making it work if any part is 64 bit.

  -- DO THIS ON A 32 BIT MACHINE IF YOU CAN!
       mkdir /apps/sybmon/mystuff
         cd /apps/sybmon/DOWNLOADS/expat-2.0.0
       configure --prefix=/apps/sybmon/mystuff
       make
       make install

The above will install to /apps/sybmo/mystuff instead of /usr/local/lib. It creates some .a/.so and some .h's.

XML::Parser was also downloaded in /apps/sybmon/DOWNLOADS. The out of the box code does NOT work if you had to rebuild libexpat. It will find the wrong libexpat.so. The bad code does something like:

   LD_RUN_PATH=/usr/local/lib; cc -shared -L/usr/local/lib Expat.o -o ... -L /a/b/lib -lexpat

This causes the build to use the original Expat.a in /usr/local/lib

      /usr/local/bin/perl-5.8.2 Makefile.PL EXPATLIBPATH=/apps/sybmon/mystuff/lib EXPATINCPATH=/apps/sybmon/mystuff/include  PREFIX=/apps/sybmon/lib
      vi Makefile */Makefile
         - LDDLFLAGS = -shared -L/usr/local/lib
         - LDFLAGS =  -L/usr/local/lib
         + LDDLFLAGS = -shared
         + LDFLAGS =
      make
      make test

Note that you need to actually edit two Makefiles. I shortened LD_LIBRARY_PATH too - adding /apps/sybmon/mystuff/lib to it too.

Finally... i needed to move all the stuff in the target directory up to a top level and set

   export perlargs=-I/apps/sybmon/lib

q) I have an Installation failure on some kind of _BAK table

   > perl upgrade.pl

   [ snip ]
    TABLE      ContainerMap                   SAVE  drop  Install Restore
    TABLE      ContainerOverride              SAVE  drop  Install Restore
    TABLE      Container_full                 SAVE  drop  Install Restore

   *****************************************************
   Cant Backup Table Event.  Event_BAK allready exists! This indicates that a prior release failed.  Event_BAK is a backup of Event prior to the upgrade - make sure that the data is ok, dr
   op Event_BAK, and rerun this command
   *****************************************************
   /apps/sybmon/perl/bin/perl  -I/apps/sybmon/dev/lib  /apps/sybmon/dev/bin/configure.pl --LOGFILE=logs/upgrade_part2.log --UPGRADE

a) You have a prior failed upgrade and a table archive (with the _BAK extension) exists. You are probably ok to just drop the
   _BAK table but you would be better served to

insert Event select * from Event_BAK drop table Event_BAK

q) While installing GEM on a windows system I receive the followingn error messages during the ppm install DBI :

C:\Workfiles\GEM\gem>ppm PPM - Programmer's Package Manager version 3.2. Copyright (c) 2001 ActiveState Corp. All Rights Reserved. ActiveState is a division of Sophos.

Entering interactive shell. Using Term::ReadLine::Perl as readline library.

Type 'help' to get started.

ppm> install DBI Error: No valid repositories: Error: 500 Can't connect to localhost:80 (connect: Unknown error) Error: 500 Can't connect to localhost:80 (connect: Unknown error) ppm> install DBI Error: No valid repositories: Error: 500 Can't connect to localhost:80 (connect: Unknown error) Error: 500 Can't connect to localhost:80 (connect: Unknown error) ppm>

Any suggestions?

a) I have re-installed active perl and added the DBD::ODBC manually and now it works fine.

q) I have reinstalled a system and PcServiceChecker is complaining about services being down.

a) You need to reinitialize conf/pc_service.dat. This is a good example of a procedure. We know what complains. Its the Batch PcServiceChecker.ksh. So we run it : Here is my session

   [G:/dev/win32_batch_scripts/interactive] Win32ServiceCheckerInit.ksh --HELP
   Unknown option: help
   Bad Parameter List Bad file descriptor
   Usage: pc_service.pl  - show all nt services
    --OUTFILE=outfile - save results to outfile
    --DEBUG
    --SYSTEMS=[system,system]
             if system=ALL will work on all systems in cfg file
             if system=Local will work on local system
    --ERRORLOG=errorlog - errorlog
    --SERVICE=service - show services matching
    --PATERN=patern - show services matching patern
    --EXCLUDE_PAT=patern - exclude services matching patern
    --RUNSTATE=runstate - show services with state matching patern
    --ACTION=action  - START|STOP|SNAPSHOT|VALIDATE
             if action is SNAPSHOT then a snapshot is taken
             if action is VALIDATE then a validate vs snapshot

many of the above can take csv list as an arg

[G:/dev/win32_batch_scripts/interactive] cat PcServiceCheckerInit.ksh C:/perl/bin/perl.exe //samba666/sybmon/dev/ADMIN_SCRIPTS/bin/pc_service.pl --ACTION=SNAPSHOT $*

[G:/dev/win32_batch_scripts/interactive] PcServiceCheckerInit.ksh --SYSTEMS=WIN32_SERVER1 Saving Snapshot into //samba666/sybmon/dev/conf/pc_service.dat Deleting Data For WIN32_SERVER1 Delete Heartbeat where monitor_program='PcServiceChecker' and system='WIN32_SERVER1' 44 services saved for WIN32_SERVER1

[G:/dev/win32_batch_scripts/interactive]

If we now compare pc_service.dat with a saved version, we see only the services for WIN32_SERVER1 have been replaced.


PROCESS NOTES

SYNOPSIS

The following describes the major processes involved within the GEM system

SYBASE BACKUP CROSSCHECK

SQL SVR BACKUP CROSSCHECK

The following batches read event log info and store the results in the database. After storing the results, they run the script UpdateBackupStateStaticInfo.pl to fix up static info (like the list of working databases in the system) and then will run a reporting tool Backup_Crosscheck_Report.pl which reads crosscheck.dat and compares the results to the saved values in the BackupState table.

   MssqlBackupCrosscheck.ksh
   MssqlBackupCrosscheckWeekly.ksh

To collect data initially, we suggest you run the above with --NOALARM so you dont get totally spammed with alarms about databases you dont care about. Once you do the initial run (with --NOALARM) look at the standard output for the job and appropriately edit crosscheck.dat to remove any databases for which you dont care about backups and to appropriately have the system handle/manage your log shipping. By setting up the directives in this config file, you can inform GEM that systems should be log-shipped and it will intelligently understand that means that tran dumps must happen on primary and loads happen on secondary and that the database names must match between the systems.

SYBASE LOG FILE CHECKS

The following Jobs Relate To Fetching Sybase Log Files

SybErrLogAllRpt.ksh Generates "Sybase Error Log - UnFiltered" SybErrLogFetch.ksh Fetch The Logs & Generate Console Sybase Error Log Fetch Report SybErrLogSaveAlarms.ksh Save Alarms From Prefetched Files - Report in "Sybase Error Log - Recent" SybErrLogConfig.ksh Generates The Console Sybase Error Log Configuration Report SybErrLogRpt.ksh Generates "Sybase Error Log - Filtered"

The best mechanism to approach this process is to look at the Configuration Report and to remove any log files that are irrelevant -> the way we do this is to actually mark the RUN files associated with the log files as bad.

SQL SVR LOG FILE CHECKS

CONFIGURATION CHECKER

allsrv_query_long.pl --QUERY=select @@SERVERNAME,value,comment from sysconfigures where comment="procedure cache size" --TYPE=SYBASE

REPLICATION MONITOR

CLEANING UP FILES



This output is documentation for the SQL Technologies GEM FAQ and Change Log.
copyright © 1998-2008 By SQL Technologies