[ Issue ] Concurrent Manager startup errors out

Hello All,
Few days back , we encountered an error while starting Concurrent Managers ;
Here is the log file [segment]
Error :
=========================================================
Check that your system has enough resources to start a concurrent manager process. Contact your system administ : 18-AUG-2009 13:44:33
Starting PASMGR Concurrent Manager : 18-AUG-2009 13:44:33
CONC-SM TNS FAIL
Routine AFPEIM encountered an error while starting concurrent manager PASMGR with library /m03/DEV/apps/apps_st/appl/pa/12.0.0/bin/PALIBR.
Check that your system has enough resources to start a concurrent manager process. Contact your system administrato : 18-AUG-2009 13:44:33
Process monitor session ended : 18-AUG-2009 13:44:33
Process monitor session started : 18-AUG-2009 13:46:33
Could not contact Service Manager FNDSM_APPSDBA1_DEV. The TNS alias could not be located, the listener process on APPSDBA1 could not be contacted, or the listener failed to spawn the Service Manager process.
Could not contact Service Manager FNDSM_APPSDBA_DEV. The TNS alias could not be located, the listener process on APPSDBA could not be contacted, or the listener failed to spawn the Service Manager process.
Starting RCVOLTM Concurrent Manager : 18-AUG-2009 13:46:33CONC-SM TNS FAILRoutine AFPEIM encountered an error while starting concurrent manager RCVOLTM with library /u03/DEV/apps/apps_st/appl/po/12.0.0/bin/RCVOLTM.
Check that your system has enough resources to start a concurrent manager process.
Contact your system administra : 18-AUG-2009 13:46:33
Starting PODAMGR Concurrent Manager : 18-AUG-2009 13:46:33CONC-SM TNS FAIL
=========================================================

Cause :
Some of the libraries of FNDSM/FNDLIBR must be missing or corrupted.

Solution :
1] Shutdown all the services.
2] Log in as applmgrcd to $FND_TOP/patch/115/sql
Run the script: afdcm037.sql
3] Relink FNDSM and FNDLIBR executables as mentioned below:
$ adrelink.sh force=y link_debug=y "fnd FNDLIBR"
$ adrelink.sh force=y link_debug=y "fnd FNDSM"
4] Run cmclean.sql
5] Start up the Services and retest.

Refer :
Metalink note-id : 460578.1 , 555081.1

[ How To ] Validate DBC file in Oracle Applications

This command will validate your DBC file , incase you encounter issues like " Database Connection Fails with Java Exception "
Cmd :
[appldev@appsdba install]$ $IAS_ORACLE_HOME/appsutil/jdk/jre/bin/java oracle.apps.fnd.security.AdminAppServer apps/apps STATUS DBC=$FND_SECURE/DEV.dbc
Database Server
---------------
DATABASE_ID: DEV
AUTHENTICATION: OFF

Application Server
------------------
APPL_SERVER_STATUS: VALID
APPL_SERVER_ID: 6D8F64B74A528627E040E00A887E308773406321633472009781846406505215
[appldev@appsdba install]$


Other metalink note-ids which can be referred for DBC:
150475.1 Database Connection Fails with Java Exception when Running adgendbc.sh.
160291.1 How to Use the AdminAppServer Utility To Delete a DBC File in
Oracle Application Object Library 11.0 & 10.7N for Windows.
144581.1 How to Use the AdminAppServer Utility To Update a DBC File in Oracle Application Object Library 11.0 & 10.7N for Unix
160295.1
146402.1 How to Create a Database Connection (DBC) File From the template.dbc File
in Release 10.7N & 11
821037.1 reventing access via "/forms/frmservlet/" in Release 12.
270802.1 adgendbc.sh not updating Fnd_application_servers
168228.1 java.sql.SQLException Running adgendbc.sh
458282.1 Context Variables
353605.1 DBC File Naming Conventions for Discoverer Connections to Oracle Applications 11i and 12i

[ How To] Upgrade EBS from 12.0.4 to 12.1.1

Hello All,

Recently we upgraded our current system from 12.0.4 /10.2.0.3 to 12.1.1/10.2.0.4 .


Below is the overview of what all steps we performed.

Database Upgrade : 10.2.0.3 to 10.2.0.4

A] Applying 10204 patchset 3 on existing oracle home.
1] Set the inventory in /etc/oraInst.loc .
2] unzip 6810189 patch with owner of database.
3] cd Disk1 >> ./runInstaller
4] Source the oracle home path which needs to be upgraded.
>> Post Patches [5868257 , 5386204] on upgraded home. [ using opatch]

B] Upgrade Steps
1] Login as database user. [ and sqlplus "/as sysdba"]
2] startup upgrade.
3] cd $OH/rdbms/admin
@utlu102i.sql
4] @catupgrd.sql
5] Run utlrp.sql for compiling invalid objects.
6] Check dba_registry for status [ must be VALID for all Components ]
7] Shutdown immediate.
8] Startup.

C] Post Steps
1] Run adgrants.sql [$ORACLE_HOME/appsutil/admin ]
sqlplus "/as sysdba" @adgrants.sql applsys
2] Run adstats.sql [ database should be restrict mode ]

Applications Upgrade : 12.0.4 to 12.1.1

Prereq :
>> Check for Invalid objects
>> Bring down the Application.
>> Enable Maintenance Mode.

A] Upgrade OracleAS 10g Release 3 (10.1.3) to Patchset 4 (10.1.3.4) :
1] Apply patches : 7237313, 7359933 + opatches [ review from document mentioned below]

B] Upgrade Oracle E-Business Suite Release 12 JDK to Java 6.0 latest update.
Download Java SE Development Kit 6u13 (jdk-6u13-linux-i586-rpm.bin) from http://java.sun.com/javase/downloads/index.jsp

C] Upgrade OracleAS 10g Release (10.1.2) for Forms and Reports to Patchset 3 (10.1.2.3)
1] Apply patch 5983622
2] Post Patches [opatch ] reviewed from Metalink note-id mentioned below.
3] Apply Interop patch 7120543 on 10.1.2.3 Home

D] Apply the AD Minipack : 6767273 , 7461070

E] Apply EBS Maintenance Pack : 7303030

Follow Post steps from 752619.1

Hurray !! You have successfully upgraded your EBS from 12.0.4 to 12.1.1