find sql's with multiple hash values in last one hour.

 --- Below code will tell us if we have multiple plans for a given sql_id when looked at a sql_id 

select sql_id,sum(executions_delta),avg(TPE),plan_hash_value,app from

(

SELECT sql_id,executions_delta,

round((elapsed_time_delta)/decode((executions_delta*1000000),0,1,(executions_delta*1000000)),6) TPE,plan_hash_value

,CASE(A.module) when 'JDBC Thin Client'  then 'JDBC' else A.module end app 

FROM  dba_hist_sqlstat A

JOIN  dba_hist_snapshot ss

  ON  A.snap_id = ss.snap_id

WHERE 

(ss.end_interval_time between (sysdate -1/24) and sysdate ) and 

 A.module not in ('em? agent_SQL_oracle_database','emagent_AQMetrics','Oracle Enterprise Manager.Metric Engine') 

  and rownum <200

order by 2 desc)

group by sql_id,plan_hash_value,app

order by 1 desc;

-- Details:-

SELECT sql_id,

to_char(begin_interval_time,'DD HH24:MI') begin_interval_time,to_char(ss.end_interval_time,'DD HH24:MI') end_interval_time,executions_delta,

round((elapsed_time_delta)/decode((executions_delta*1000000),0,1,(executions_delta*1000000)),6) TPE,plan_hash_value

,CASE(A.module) when 'JDBC Thin Client'  then 'JDBC' else A.module end app 

FROM  dba_hist_sqlstat A

JOIN  dba_hist_snapshot ss

  ON  A.snap_id = ss.snap_id

WHERE 

(ss.end_interval_time between (sysdate -1/24) and sysdate ) and 

 A.module not in ('em? agent_SQL_oracle_database','emagent_AQMetrics','Oracle Enterprise Manager.Metric Engine') 

 and rownum <200

order by 2 desc;

Blocking session script for Oracle

Below code is used to find the blocker and waiters in the Oracle Database.

code:-

select chn_id,sid,ses_serial,status,blkr_sid,Final_BLK_SES,wait_event,Process,osuser,sql_id,Machine,program,Wait_Secs,sql_text from (SELECT wc.chain_id CHN_ID,
 wc.sid,
  wc.sess_serial# ses_serial,
 CASE
   WHEN DECODE(blocker_sid,NULL,'',blocker_sid) IS NULL
   THEN 'blocker'
   ELSE 'waiter'
 END AS status,
  DECODE(blocker_sid,NULL,'',blocker_sid) blkr_sid,
  s.final_blocking_session Final_BLK_SES,
  wait_event_text wait_event,
  s.Process,
  s.osuser,
  s.sql_id,
 SUBSTR(s.machine,1,INSTR(s.machine,'.',1)-1) Machine ,
 SUBSTR(s.program,1,INSTR(s.program,'.',1)-1) program,
  in_wait_secs Wait_Secs
 ,dbms_lob.substr(q.sql_text,50,1) sql_text
FROM v$wait_chains wc, gv$session s,gv$session bs,gv$instance i,gv$process p ,gv$sql q
WHERE wc.instance              = i.instance_number (+)
AND s.sql_id                   =q.sql_id(+)
AND (wc.instance               = s.inst_id (+)
AND wc.sid                     = s.sid
AND wc.sess_serial#            = s.serial# (+))
AND (s.final_blocking_instance = bs.inst_id (+)
AND s.final_blocking_session   = bs.sid (+))
AND (bs.inst_id                = p.inst_id (+)
AND bs.paddr                   = p.addr (+))
AND ( num_waiters              > 0
OR ( blocker_osid             IS NOT NULL
AND in_wait_secs               > 10 ) ) ---- change here for secs in wait
  CONNECT BY PRIOR wc.sid      = blocker_sid
AND PRIOR wc.sess_serial#      = blocker_sess_serial#
AND PRIOR i.inst_id            = blocker_instance
  START WITH blocker_is_valid  = 'FALSE')
  group by chn_id,sid,ses_serial,status,blkr_sid,Final_BLK_SES,wait_event,Process,osuser,sql_id,Machine,program,Wait_Secs,sql_text
  ORDER BY chn_id,wait_secs DESC;

Thank you,

Sivaram

Enable - Disable Cron Jobs in Linux/AIX/Unix with single command line input

 Here in this we are using "#outage" to the start of line for all lines in Cron to disable and vice-versa.

Disable :-

crontab -l | sed -e 's/^/#outage/' | crontab


Enable:-
crontab -l | sed -e 's/^#outage//' | crontab


Hope this helps......

Mysql- Master - Slave Replication setup.

Below steps should be done in same outage. Take Master server down and take backup and restore to the slave side to make sure they both are look-alike as per Data.


1) Add below parameters in /etc/my.cnf for Master-side Mysql Instance and for Slave-side Mysql Instance repectively.

Master-side Configuration:
# To enable MySQL replication, you need to enable binary logging.

sync_binlog=1  # enable "1" if replication is used for master else comment this to disable
binlog_checksum = NONE
binlog_format = STATEMENT
log-bin=/mysql/log/hostname-bin.log
log-bin-index=/mysql/log/hostname-bin.index

Slave-side Configuration:

skip-slave-start   # it will not start replication automatically when mysql is started.
relay-log=/mysql/log/slave-relay-bin
relay-log-index=/mysql/log/slave-relay-bin.index


2) stop mysql on Master side and Slave side.
systemctl stop mysqld

3) start mysql on Master side and Slave side.
4) On Master-Side:
   create user 'repl_user'@'Slave-IP' identified by 'Password#';
   grant replication slave on *.* to 'repl_user'@'Slave-IP' identified by 'Password#';
   flush privileges;
   FLUSH TABLES WITH READ LOCK;
   show variables like 'sql_log_bin';
   set sql_log_bin=0;  --- to disable binary logging    we are doing this to disable replication for sometime till we setup slave with master backup and config etc.
   -- when ready to run command on step 5 on Slave-side
   unlock tables;
   reset master;
   show master status\G; --- note down the details for below command on slave side.
 
     
5) On Slave_side:
CHANGE MASTER TO MASTER_HOST='MAster-IP',MASTER_USER='repl_user',MASTER_PASSWORD='Password#',MASTER_LOG_FILE='hostname-bin.000001',MASTER_LOG_POS=50;
start slave;
show slave status\G;
show processlist\G; ---- check and see if you see replication process is running on both sides.

6) create a dummy table(and insert rows) on Master-Side and see if it got created on Slave-side.

MySQL - Session Alert script

Below scripts are needed to find the Current Sessions live in Mysql instance:


Two sql scripts you need in the same folder as shell script:- which are in RED color in the script.

1) session_count.sql

tee ./logs/session.log
select count(*) from information_schema.processlist;
notee;

2) session_details.sql

tee ./logs/session_details.html
select user,SUBSTR(HOST,1,INSTR(HOST,':')-1) as "Host",db,command,state,count(*) as "Number of sessions" from information_schema.processlist group by user,SUBSTR(HOST,1,INSTR(HOST,':')-1),db,command,state;
notee;

Code for the Shell Script:-

**************************************************

#!/bin/ksh

#########################################################################
# PROGRAM NAME: session_count.sh   for MySQL
#
# USAGE: ./session_count.sh
#
# Siva
#########################################################################

COMMAND=$0
PGM=${COMMAND##*/}
DATE=$(date "+%Y%m%d%H%M")
hostname=`hostname -s`
MAILTO=Name@domain.com
PWD=/scripts/sessions  # put script dir path if you want to run from "crontab"
repdir=$PWD
LOG=$repdir/logs

if [ ! -d $LOG ]; then
mkdir  $LOG
else
rm $LOG/session.log
if [ -f $LOG/session_details.html ]; then
rm $LOG/session_details.html
fi
fi

####### ******************** Below list of changes are req:

conf_file=/etc/my.cnf
BACKUP_USER=root
BACKUP_PASS=`cat /oracle/.orapasswd/.backupusr`

Vald_sess_C=1  ---- Set the Valid sessions number for the mark
log_ret=15

Logfile=mysql_Session_"$hostname"_$DATE.log
echo " started $DATE" >>$LOG/$Logfile

#### Changes are done:

####### ******************** run Active file:

if [ -f $LOG/bkp_active_file ]
 then
   echo "previous mysql session_count.sh script is still running. confirm before running again" | mailx -s "Mysql-Session Status: $hostname - Failed to execute" $MAILTO
   exit 0
fi

###

touch $LOG/bkp_active_file

mysql -Ns -u root -p$BACKUP_PASS < $repdir/session_count.sql >> $LOG/mysql_Session_"$hostname"_$DATE.log 2>&1

####### ******************** Check the session count:

Check_Sess_C=`cat $LOG/session.log`

if [[ $Check_Sess_C > $Vald_sess_C ]]
then
mysql -H -u root -p$BACKUP_PASS < $repdir/session_details.sql >> $LOG/mysql_Session_"$hostname"_$DATE.log 2>&1

####### ******************** Email Output to Mail:

( echo "Subject: AUTO-Gen - HOST: $hostname - MySQL Sessions are High - Details: "
  echo "To: OracleDBAs@unfi.com"
  echo "From:  <$hostname> "
   echo "MIME-Version: 1.0"
   echo "Content-Type: text/html; charset=US-ASCII"
echo "<html>"
echo "<body>"
   echo "<font size="+2">" "<font color="red">"
   echo "<u>"
   echo "Action Needed: Mysql sessions are high - Count - $Check_Sess_C ."
   echo "</u>"
   echo "<br/>"
   echo "<font size="-1">" "<font color="black">"
   echo "<pre>"
   cat $LOG/session_details.html
   echo  "<pre>"
   echo "Successful end of $repdir/session_count.sh"
echo "</body>"
echo "</html>"
 ) | /usr/sbin/sendmail $MAILTO

### End of Email

fi

####### ******************** Purge Log directory:

if [ ! -d $LOG ]; then
mkdir  $LOG
else
/usr/bin/find $LOG -type f -mtime +$log_ret -exec rm -f {} \;
fi

####### ******************** Remove run active file:

if [ -f $LOG/bkp_active_file ]
 then
rm $LOG/bkp_active_file
echo " removed run-active file" >> $LOG/$Logfile
fi

exit

### All steps are Done.

*********************************************************************

Hope this helps.................................................

virtual indexes

Thought this would be  handy in testing the performance. By creating virtual indexes in a session you can check whether the performance of the bad sql can be improved or not before we implement it permanently.
this is feature is available from 11g.

ALTER SESSION SET "_use_nosegment_indexes" = TRUE;

create index vir_idx1 on Table_1 (col_1,col_2,col_3) nosegment;

once the Virtual Index is created run the bad sql and check the plan for the performance boost. if this work then create an index permanently.

Hope this helps.....

Mysql: mysql Enterprise backup (MEB) script

Here is the script to backup Mysql database using MEB. 

copy this below code in to script and edit to the correct directory paths and run it.

#########################################################################

#

COMMAND=$0

PGM=${COMMAND##*/}

DATE=$(date "+%Y%m%d%H")

hostname=`hostname -s`

MAILTO=XXXxx@gmail.com

PWD=/opt/scripts  # put script dir path if you want to run from "crontab"

#PWD=`pwd`      # enable this and disable above one if you want to run in nohup mode.

repdir=$PWD

LOG=$repdir/dblogs

##*********** Below list of changes are req: 

conf_file=/etc/my.cnf

BACKUP_USER=root

BACKUP_PASS=`cat /opt/.orapasswd/.backupusr`

bkp_type=$1

ret_time=$2

Logfile=mysql-MEB_"$bkp_type"_"$hostname"_$DATE.log

log_ret=15

echo " started $DATE" >>$LOG/$Logfile 

#### Changes are done:

##***************** run Active file:

if [ -f $LOG/active_file ]

 then

   echo "previous mysql backup is still running. confirm before running again" | mailx -s "Mysql-Backup: $hostname - Failed for $bkp_type backup" $MAILTO

   exit 0

fi

## Validate Log directory:

if [ ! -d $LOG ]; then

mkdir  $LOG

else 

/usr/bin/find $LOG -type f -mtime +$log_ret -exec rm -f {} \;

fi

#******* Checking the input parameter: 

if [ $# = 0 ]

then

echo "Please enter the first parameter for backup type (FULL) and second parameter as a number in days for backup retention" |tee -a $LOG

exit 1

fi

##************ setting the backup-dir path for the Backup location:

bkup_dir=/backup_folder/$hostname/meb/$bkp_type

if [ ! -d $bkup_dir ]; then

mkdir -p $bkup_dir 

fi

echo " Mysql-backup: $bkp_type files are located under $bkup_dir" >>/$LOG/$Logfile

echo ""

####### End of backup-dir path setup

touch $LOG/active_file

##************ Running Backup from above inputs:

echo "Running $bkp_type Backup from above inputs"

if [ $bkp_type = 'FULL' ] ; then

   /opt/mysql/meb-4.1/bin/mysqlbackup --defaults-file=$conf_file --port=3306 --protocol=tcp --user=$BACKUP_USER --password=$BACKUP_PASS --with-timestamp --backup-dir=$bkup_dir backup-and-apply-log >>$LOG/$Logfile 2>&1

else

echo "Incorrect input parameter - please enter a correct backup type" |tee -a $LOG/$Logfile

fi

####

 

##********* check Any errors in the logfile:

error_chk=$(cat $LOG/$Logfile | awk 'BEGIN{buf=""} /[0-9]:[0-9][0-9]:[0-9]/{buf=$0} /WARNING|warnings|ERROR/{print buf,$0}' | wc -l)

if [[ $error_chk -eq 0 ]]

  then

     echo "Mysql Backup for backup-type $bkp_type completed successfully - no errors $error_chk " >>$LOG/$Logfile

   else

    echo "Mysql Backup for backup-type $bkp_type was unsuccessful - errors $error_chk. check and run again" >>$LOG/$Logfile

   echo "Mysql Backup for backup-type $bkp_type completed but has errors - $error_chk . please check" | mailx -s "Mysql-Backup - $bkp_type : Completed with errors" $MAILTO

fi

####

##******** remove run active file:

if [ -f $LOG/active_file ]

 then

rm $LOG/active_file 

echo " removed run-active file" |tee -a $LOG/$Logfile

fi

echo "Mysql-backup: All steps are done" |tee -a $LOG/$Logfile

exit 0;

###################################################

hope this helps........................................