Quantcast
Channel: Oracle and Other Technology Notes
Viewing all 84 articles
Browse latest View live
↧

Missing Named Credentials in OEM 12c

August 28, 2014, 5:56 am
$
0
0

We are seeing that the list sometimes doesn’t show all the named credentials.

Yet to see if this resolves the issue but need to restart OMS …

emctl set property -name oracle.sysman.emdrep.creds.region.maxcreds -value 500

Oracle Enterprise Manager Cloud Control 12c Release 3

Copyright (c) 1996, 2013 Oracle Corporation.  All rights reserved.

SYSMAN password:

Property oracle.sysman.emdrep.creds.region.maxcreds has been set to value 500 for all Management Servers

OMS restart is required to reflect the new property value

Ref:

EM 12c: Missing Named Credentials in the Enterprise Manager 12c Cloud Control Jobs Drop Down List (Doc ID 1493690.1)

↧
Search

Monitoring the Filesystem for READONLY mounts using Metric Extension in OEM12c

August 28, 2014, 6:29 am
$
0
0

Our Client faced many times the mounted  filesystem going into READONLY status.

We created this User Defined Metrics or now called as Metric Extesnion to monitor and send alert.

image

 

image

 

image

 

#!/bin/sh

#echo "SlNo MountPoint MountStatus"
nl  /etc/mtab |/bin/awk '{print $1"|" $3"|"substr($5,1,2)}'

 

image

 

image

 

Credentials

Host Credentials
: Uses Monitoring Credentials of Target.

 

You have to create a NamedCredential set to test this like this and then set the username and password for this set from Security->Monitoring Credentials:

emcli create_credential_set -set_name=SOA_ORABPEL_STAGE -target_type=oracle_database -auth_target_type=oracle_database -supported_cred_types=DBCreds -monitoring -description='SOA ORABPEL DB Credentials'
↧
↧

Creating FMW12c Domain using EM12c User Defined Deployment Procedure

October 21, 2014, 3:03 pm
$
0
0
1. Installing Software example: Install JDK, INFRA, OSB, RCU Creation in 5 minutes, 58 seconds
image

2. Second example: creating BAM12c 2 node cluster in 9 minutes,  Create RCU, Create domain, Extend Domain, startNodemanger, start admin, start Nodemanager on Mgrserver, startall ManagedServers
image
2 Nodes, BAM Cluster
↧

Monitoring a Log pattern in SOA Log files using EM12c

October 24, 2014, 7:28 am
↧

Find and Replace in a file

November 5, 2014, 12:12 pm
$
0
0

Had to replace all the occurrence of wrong  inventory then use this:

grep -rl 'oraInventory' .  | xargs sed -i 's|'/home/emuser/oraInventory'|'/opt/app/oracle/oraInventory'|g'

↧
↧

Getting too much alerts for Database Time Spent Waiting (%) Metric in EM12c ?

November 6, 2014, 9:17 am
$
0
0

 

It is Better to set the Database Time Spent Waiting (%)= 99 in Monitoring Templates , so that any new Database discovered will gets synced with the Template collection and changes the default 30% to 99%.

 

Verify that the DBA_THRESHOLDS in target database is updated.

i.e the below query should return no rows:

SELECT metrics_name, critical_value, warning_value, object_name, status
FROM SYS.DBA_THRESHOLDS
where metrics_name like '%Database Time Spent%';

 

Refer:

How to Disable Alerts for The Database Time Spent Waiting (%) Metric? (Doc ID 1500074.1)

Database Server Generated Metrics Alerts Not Cleared In Grid Console Even After Disabling the Metric (Doc ID 786520.1)

"Database Time Spent Waiting (%)" at 100 for Event Class "Other" when Database is not Under Load (Doc ID 1526552.1)

http://docs.oracle.com/cd/E24628_01/em.121/e25160/oracle_database.htm#EMDBM3180

↧

Seeing slow startup of SOA OSB and other Java based application then verify Entropy

November 10, 2014, 7:20 am
$
0
0
We faced slow startup of Domain Creation, slow startup  of Domain and resolved using proper Entropy settings:
You should be able to select the faster-but-slightly-less-secure /dev/urandom on Linux using:
$JAVA_HOME/jre/lib/security/java.security
Default /dev/urandom is configured, but as mentioned this is ignored by Java.
-Djava.security.egd=file:/dev/urandom
However, this doesn’t work with Java 5 and later (Java Bug 6202721). The suggested work-around is to use:
-Djava.security.egd=file:/dev/./urandom(note the extra ‘/./’)
 
You can also set in your environment like below in setDomainEnv.sh
if[ "${USER_MEM_ARGS}"!= ""] ; then
MEM_ARGS="${USER_MEM_ARGS}
exportMEM_ARGS
fi
MEM_ARGS="${MEM_ARGS} -Djava.security.egd=file:/dev/./urandom"
 
 
Or at runtime:
exportCONFIG_JVM_ARGS="-Djava.security.egd=file:/dev/./urandom"
/u01/app/oracle/product/fmw/wlserver_12.1/common/bin/config.sh
 
References:
http://theheat.dk/blog/?p=1539
http://stackoverflow.com/questions/137212/how-to-solve-performance-problem-with-java-securerandom

















↧

How to uninstall/remove EM12c Agent

November 11, 2014, 1:59 pm
$
0
0

./emctl stop agent


/opt/app/oracle/agent12c/core/12.1.0.3.0/perl/bin/perl /opt/app/oracle/agent12c/core/12.1.0.3.0/sysman/install/AgentDeinstall.pl -agentHome /opt/app/oracle/agent12c


rm -Rf /opt/app/oracle/agent12c


============from host where emcli is installed===============

emcli delete_target -name="test.example.com:1836" -type="oracle_emd" -delete_monitored_targets –async

 

Reference:
https://docs.oracle.com/cd/E24628_01/install.121/e24089/deinstall_agent.htm#CBBCEJHG

↧
Search

Customizing EM12c Email Format for Notification

January 23, 2015, 1:16 pm
$
0
0
Customization highlighted below:
========================BODY=================================
-- Enterprise Manager Default Event Template

-- Subject of an e-mail is rendered in one line.
-- The resulting text from the following logic will be concatenated together into one line.

-- if this is a repeat email
-- show the repeat count
[IF NOTIF_TYPE EQ "NOTIF_REPEAT"]
    \[[REPEAT_LABEL] #[REPEAT_COUNT]\]
[ENDIF]
[EM_EVENT_PREFIX]:

-- if it is an email for success or failure of corrective action
-- show the name and execution status of the corrective action
[IF NOTIF_TYPE EQ "NOTIF_CA"]
    CA:[CA_JOB_NAME]:[CA_JOB_STATUS]
[ELSE] -- Regular email for metric alert
    [TARGET_LIFECYCLE_STATUS]:[TARGET_NAME]:=>[SEVERITY]
[ENDIF]
-- Show message if available
- [TARGET_NAME]:[ORCL_GTP_DEPARTMENT]:[MESSAGE]


===========================SUBJECT==============================

-- Enterprise Manager default template

[IF ORCL_GTP_DEPARTMENT NOT NULL]
 ===========================================================
 *****ITSM Please contact  [ORCL_GTP_DEPARTMENT]  Department for this Incident Alert******
 ===========================================================
[ENDIF]


-- if the email is for the status of corrective action
-- show the details of the execution of the corrective action
[IF NOTIF_TYPE EQ "NOTIF_CA"]
    [CA_JOB_NAME_LABEL]=[CA_JOB_NAME]
    [CA_JOB_OWNER_LABEL]=[CA_JOB_OWNER]
    [CA_JOB_STATUS_LABEL]=[CA_JOB_STATUS]
    [CA_JOB_STEP_OUTPUT_LABEL]=[CA_JOB_STEP_OUTPUT]
[ENDIF]

-- Source object name is the entity raising the issue.
[IF SOURCE_OBJ_NAME NOT NULL]
    [SOURCE_OBJ_TYPE] [NAME_LABEL]=[SOURCE_OBJ_NAME]
    [SOURCE_OBJ_TYPE] [OWNER_LABEL]=[SOURCE_OBJ_OWNER]
[ENDIF]
[IF SOURCE_OBJ_SUB_TYPE NOT NULL]
    [SOURCE_OBJ_TYPE] [TYPE_LABEL]=[SOURCE_OBJ_SUB_TYPE]
[ENDIF]
[IF HOST_NAME NOT NULL]
    [HOST_NAME_LABEL]=[HOST_NAME]
[ENDIF]
-- Target name links to the respective target home page
-- in Enterprise Manager console
[IF TARGET_NAME NOT NULL]
    [TARGET_TYPE_LABEL]=[TARGET_TYPE]
    [TARGET_NAME_LABEL]=[TARGET_NAME]
[ENDIF]


[IF CATEGORIES NOT NULL]
    [CATEGORIES_LABEL]=[CATEGORIES]
[ENDIF]
[MESSAGE_LABEL]=[MESSAGE]
[IF ACTION_MSG NOT NULL]
    [ACTION_MSG_LABEL]=[ACTION_MSG]
[ENDIF]
[SEVERITY_LABEL]=[SEVERITY]
[EVENT_REPORTED_TIME_LABEL]=[EVENT_REPORTED_TIME]

[IF TARGET_LIFECYCLE_STATUS NOT NULL]
    [TARGET_LIFECYCLE_STATUS_LABEL]=[TARGET_LIFECYCLE_STATUS]
[ENDIF]
[USER_DEFINED_TARGET_PROP]

[IF ASSOC_INCIDENT_ID NOT NULL]
    [ASSOC_INCIDENT_ID_LABEL]=[ASSOC_INCIDENT_ID]
    [ASSOC_INCIDENT_STATUS_LABEL]=[ASSOC_INCIDENT_STATUS]
    [ASSOC_INCIDENT_OWNER_LABEL]=[ASSOC_INCIDENT_OWNER]
    [ASSOC_INCIDENT_ACKNOWLEDGED_BY_OWNER_LABEL]=[ASSOC_INCIDENT_ACKNOWLEDGED_BY_OWNER]
    [ASSOC_INCIDENT_PRIORITY_LABEL]=[ASSOC_INCIDENT_PRIORITY]
    [ASSOC_INCIDENT_ESCALATION_LEVEL_LABEL]=[ASSOC_INCIDENT_ESCALATION_LEVEL]
[ENDIF]
[EVENT_TYPE_LABEL]=[EVENT_TYPE]
[EVENT_NAME_LABEL]=[EVENT_NAME]
-- if it is a repeat email, show the repeat count
[IF NOTIF_TYPE EQ "NOTIF_REPEAT"]
    [REPEAT_COUNT_LABEL]=[REPEAT_COUNT]
[ENDIF]
-- Event Dedup related Attributes
[IF TOTAL_OCCURRENCE_COUNT NOT NULL]
    [TOTAL_OCCURRENCE_COUNT_LABEL]=[TOTAL_OCCURRENCE_COUNT]
[ENDIF]
[IF CURRENT_OCCURRENCE_COUNT NOT NULL]
    [CURRENT_OCCURRENCE_COUNT_LABEL]=[CURRENT_OCCURRENCE_COUNT]
[ENDIF]
[IF CURRENT_FIRST_OCCUR_DATE NOT NULL]
    [CURRENT_FIRST_OCCUR_DATE_LABEL]=[CURRENT_FIRST_OCCUR_DATE]
[ENDIF]
[IF CURRENT_LAST_OCCUR_DATE NOT NULL]
    [CURRENT_LAST_OCCUR_DATE_LABEL]=[CURRENT_LAST_OCCUR_DATE]
[ENDIF]
[EVENT_TYPE_ATTRS]

[IF RCA_STATUS NOT NULL]
    [RCA_STATUS_LABEL]=[RCA_STATUS]
[ENDIF]

-- Root Cause Analysis details shows up when available. This is
-- normally applies to availability alerts for service targets
[RCA_DETAILS]

[RULE_NAME_LABEL]=[RULE_NAME]
[RULE_OWNER_LABEL]=[RULE_OWNER]
-- Check if any updates
[IF UPDATES NOT NULL]
[UPDATES_LABEL]:[UPDATES]
[ENDIF]
↧
↧

EM12c Filtering ORA-600 till the issue is resolved

January 23, 2015, 1:22 pm
$
0
0



Example alert recieved:

Host=xyz.domain.net
Target type=Database Instance
Target name=mydatabaseinstance1
Categories=Diagnostics, Fault
Message=Internal error (ORA 600 [kwqitnmphe:ltbagi]) detected in /opt/app/oracle/diag/rdbms/hogcprd/hogcprd1/alert/log.xml at time/line number: Sat Jan 17 22:53:57 2015/40570.
Severity=Critical
Event reported time=Jan 17, 2015 11:08:38 PM EST
Target Lifecycle Status=Production
Department=OEM12c
Line of Business=IT
Location=Atlanta
Operating System=Linux
Platform=x86_64
Associated Incident Id=541447
Associated Incident Status=New
Associated Incident Owner=
Associated Incident Acknowledged By Owner=No
Associated Incident Priority=None
Associated Incident Escalation Level=0
Event Type=Metric Alert
Event name=adrAlertLogIncidentError:genericInternalErrStack
Metric Group=Incident
Metric=Generic Internal Error
Metric value=Errors in file /opt/app/oracle/diag/rdbms/xyxyx/xyxyxprd1/trace/hogcprd1_q002_31608.trc (incident=365969):~ORA-00600: internal error code, arguments: [kwqitnmphe:ltbagi], [1], [0], [], [], [], [], [], [], [], [], []
Key Value=Sat Jan 17 22:53:57 2015/40570
Key Column 1=Time/Line Number
Rule Name=OEM12c_ManagementAgentRuleset,OEM12c_Performance_metric_rule
Rule Owner=EM_ADMIN
Update Details:
Internal error (ORA 600 [kwqitnmphe:ltbagi]) detected in /opt/app/oracle/diag/rdbms/xyxyxy/xyxyxprd1/alert/log.xml at time/line number: Sat Jan 17 22:53:57 2015/40570.





Original:
.*ORA-0*(54|1142|1146)\D.*

New One:
.*ORA-0*(54|1142|1146|600:.*\[kwqitnmphe[^\]]*\])\D.*


 Reference:
 EM 12c : How To Filter Specific ORA-00600 Error In Order To Avoid ORA-600 Alerts to be Raised In Console ? [ID 1592764.1]
↧

Moving Oracle Inventory from one location to Another

February 4, 2015, 11:03 am
$
0
0
Moving Oracle Inventory from one location to Another:

cp -pR /home/emuser/oraInventory/*  /opt/app/oracle/oraInventory

sed -i 's|'/home/emuser/oraInventory'|'/opt/app/oracle/oraInventory'|g' oraInst.loc
sed -i 's|'/home/emuser/oraInventory'|'/opt/app/oracle/oraInventory'|g' orainstRoot.sh


grep -rl 'oraInventory' ./ | xargs sed -i 's|'/home/emuser/oraInventory'|'/opt/app/oracle/oraInventory'|g'

vi /etc/oraInst.loc
inventory_loc=/opt/app/oracle/oraInventory
inst_group=oinstall


[root@myhostname oraInventory]# ./orainstRoot.sh
Changing permissions of /opt/app/oracle/oraInventory
Adding read,write permissions for group,Removing read,write,execute permissions for world.
Changing groupname of /opt/app/oracle/oraInventory to oinstall.
The execution of the script is complete
 
↧

Changing Target ownership after the discovery of Targets in EM12c

February 5, 2015, 2:29 pm
$
0
0
Building emcli commands to Change ownership of  Targets


select 'emcli change_target_owner -target="'||target_name||':host" -owner="EM_ADMIN" -new_owner="WEB_ADMIN"' from mgmt$target where target_type='host' and target_name like 'mypattern%'

Ref:
http://docs.oracle.com/cd/E24628_01/em.121/e17786/cli_verb_ref.htm#CACGFIDA

↧

EM 12C RACI and Maintenance Task

February 13, 2015, 8:10 am
$
0
0
ENTERPRISE MANAGER 12C RACI
TASK RESPONSIBLE ACCOUNTABLE CONSULTED INFORMED
Define Monitoring RequirementsTarget Owners, Infrastructure Teams, EM Admin EM Admin
Installation planning and architectureEM AdminEM AdminTarget Owners, Infrastructure
Installation and configuration of EMEM AdminEM Admin
Defining Agent deployment and patching procedures and processesEM AdminEM Admin
Security and User AdministrationEM Admin/Security AdminEM Admin
Admin Group CreationEM AdminEM AdminTarget Owners
Agent Deployment (can be performed by target owners)Target OwnersTarget OwnersEM Admin
Agent Patching (can be performed by target owners)Target OwnersTarget OwnersEM Admin
Target Configuration and AvailabilityTarget OwnersTarget Owners
Agent TroubleshootingTarget Owners, EM AdminEM Admin
Target TroubleshootingTarget OwnersTarget OwnersEM Admin
Weekly/Monthly/Quarterly MaintenanceEM AdminEM AdminTarget Owners
OMS PatchingEM AdminEM AdminTarget Owners
RECOMMENDED MAINTENANCE TASKS
TASKDAILYBIWEEKLYMONTHLYQUARTERLY
Review critical EM component availabilityX
Review events, incidents and problems for EM related infrastructureX
Review overall health of the system including the job system, backlog, load, notifications and task performanceX
Review Agent issues for obvious problems (i.e. large percentage of agents with an unreachable status)X
Review Agent issues (deeper /more detailed review of agents with consistent or continual problems)X
Review metric trending for anything out of boundsX
Evaluate database (performance, sizing, fragmentation)X
Check for updates in Self Update (plug-ins, connectors, agents, etc.) Note that there is an out-of-box ruleset that will provide notification for the availability of new updatesX
Check for recommended patchesX
References:
↧
↧

Monitoring BRM Host Processes using Metric Extension in EM12c

May 13, 2015, 9:01 am
$
0
0
image

#/bin/sh
export CURRENT_USER=brm
#echo 'PROCESS_NAME'  'COUNT'
for p in dm_oracle cm dm_aq dm_ifw_sync wirelessRealtime.reg
do
CNT=`ps -ef | grep ${CURRENT_USER} | grep ${p} | grep -v grep | wc -l`
echo ${p} '|' ${CNT}
done


image
↧

EM12c 12.1.0.4 Summary of Installation Steps

June 12, 2015, 8:08 am
$
0
0
1. Install EM12c using Advanced without choosing the “Download Update”

2. Install Latest JDK 1.6 (Note: 1944044.1) JDK 1.6.0.95.. Updated to 1.6.0.95

3. Install Latest PSU for EM12cR4 Note: 1995267.1

4. Install latest Plugins

5. Install Monthly Plugin patches for OMS (Doc ID 1900943.1 & Doc ID 1664074.1)

6. Install Monthly Plugin patches for Agent (Doc ID 1900943.1 & Doc ID 1664074.1)

7. Install WebLogic latest PSU (1470197.1)

8. Configure Load Balancer

9. Configure additional OMS

10. Configure LDAP

11. Install & Configure JVMD Servers

12. Install & Configure BI Publisher
 
Reference:
http://docs.oracle.com/cd/E24628_01/install.121/e22624/toc.htm
http://docs.oracle.com/cd/E24628_01/install.121/e24089/toc.htm
Get ready DB12c as per Note: 12c Database has been certified as a 12cR4 Repository with Certain Patchset Restrictions (Doc ID 1987905.1)
Latest plug-ins can be downloaded from :
http://www.oracle.com/technetwork/oem/grid-control/downloads/oem-upgrade-console-502238.html

















↧
Search

EM12c Agent Properties

July 20, 2015, 2:40 pm
↧

Forcing Garbage Collection in JDK manually using JVisualVM

September 14, 2015, 12:43 pm
$
0
0
You might have seen many times heap crossing the limit and GC algorithm not working properly and keeping old object long time.
Even though it is not advised to force major GC manually if you come across a situation you can use the following method to clear the Heap.
Note. If the Heap size is huge more than 6GB doing major GC may cause application to wait for couple of seconds. Also, make sure you have enough system memory(RAM) to invoke the tool JVisualVM.
This is typical method in many corporates where X-Windows is not installed on their *NIX machines and app account is locked down for direct login.
1) Login as yourself into Linux/Unix machine and make sure your laptop/Desktop has X-emulator like xming running.
2) Note down the authorized X-keys:    xauth list
3) Login as app owner :     sudo su – oracle
4) Add the X-keys to oracle(App owner session)
xauth add <full string from xauth list from previous session>
image

5) Do ps –ef|java , note down the JDK directory and go directly to JDK bin (/opt/app/oracle/jdk1.7.0_55/bin ) in this case we are using JDK7
6) Invoke  ./jvisualvm &
7) Choose the Weblogic PID and make sure in the Overview tab the server name is the one you are interested and Perform manual GC.
  Note: From JDK 7 onwards if your Heap size is more than 6GB then G1GC algorithm works in best possible ways. 
     Also refer: https://blogs.oracle.com/g1gc/

image
↧
↧

EM12c 12.1.0.5 Upgrade Tasks

September 14, 2015, 12:51 pm
$
0
0
1.      Upgrade Primary OMR, OMS using Installer of 12.1.0.5   - 2 Hours

2.     Upgrade Primary Agent      - 6 Minutes

3.      Cleanup Agent

4.      Cleanup OMS

5.      Upgrade Secondary  OMS     - 30 Minutes

6.      Cleanup Agent

7.      Cleanup OMS

8.      No Monthly Agent/OMS Pacthes available yet for 12.1.0.5 - Jul-14-2015 expected Jul-30-2015

9.  Install Latest JDK 1.6 (Note: 1944044.1) JDK 1.6.0.95.. Updated to 1.6.0.95

10.     Install Weblogic latest PSU (1470197.1)  

11. Verify Load Balancer

12.  OMS Sizing


↧

How to delete older emails from GMAIL

October 7, 2015, 7:40 am
$
0
0

image

image

 

Other category:

category: social older_than:45d

↧

EM12c Agent generating heapDump_*.hprof

October 27, 2015, 12:43 pm
$
0
0
By default Em12c Agent has enabled -XX:+HeapDumpOnOutOfMemoryError. We need to change the log directory to other directory or disable the Dump before it fills up Agent partition.
  --  -XX:-HeapDumpOnOutOfMemoryError   or  -XX:HeapDumpPath=/home/oracle/logs/
 
You can put these entries in AGENT_INST/sysman/config/s_jvm_options.opt
Agent has a auto tuning feature which increases Xmx automatically whenever it goes out of memory and dumps the memory.
We  disabled the Dump by putting this entry   -XX:-HeapDumpOnOutOfMemoryError     in file  AGENT_INST/sysman/config/s_jvm_options.opt and did emctl stop agent;emctl start agent.
 
Also, if you think if the agent memory auto tuning is not working you can disable that .. if you see a frequent restart or failing to start due to outOfMemory errors.
You can change  in emd.properties
#Enable auto tuning out of the box
enableAutoTuning=true false

Change the default Xmx
# These are the optional Java flags for the agent
#
agentJavaDefines=-Xmx512M -XX:MaxPermSize=96M
Note: This is not recommended by Oracle Dev team.








↧
Viewing all 84 articles
Browse latest View live
Search