Wednesday, May 26, 2010

Metalink Note-IDs related to Concurrent Managers

1) Concurrent Processing Tables and Purge Concurrent Request and/or Manager Data Program (FNDCPPUR) [ID 104282.1]

2) Purge Concurrent Request FNDCPPUR Does Not Delete Files From File System or Slow performance [ID 822368.1]

3) Best Practices for Performance for Concurrent Managers in E-Business Suite [ID 1057802.1]

4) Using the Output Post Processor (OPP) in Oracle Applications Concurrent Processing [ID 291792.1]

5) Cannot View Concurrent Manager Log And Out Files in R12 (APP-FND-01634 ) [ID 555394.1]

6) Deadlock Error During Concurrent Request Termination [ID 1060736.1]

7) Concurrent Processing (CP) / APPS Reporting Scripts [ID 213021.1]

8) How to Activate Parallel Concurrent Processing - More Facts [ID 602899.1]

9) How to Configure Concurrent Managers Applications for Parallel Concurrent Processing [ID 157352.1]10) Performance: Purge Obsolete Workflow Runtime Data ( FNDWFPR ) Concurrent Request is Slow [ID 985332.1]

11) Concurrent Requests Errors Out With ORA-20100: Error: FND_FILE Failure [ID 460643.1]

12) In R12 Get APP-FND-01564 ORA-01116 ORA-01110 ORA-27041 Errors When Running Concurrent Requests [ID 577291.1]

13) Performance Degradation When Submitting a Concurrent Request [ID 563434.1]

14) Concurrent Mangagers Down Cause Of Output Post Process Failing To Start [ID
798362.1]

15) How To Create a Java Concurrent Program? [ID 827563.1]

16) How to Troubleshoot Concurrent Manager Start Up Issue Related to Service Manager [ID 735148.1]

17) How To Submit A Concurrent Request Set Using Fnd_Request.Submit_Request [ID 382791.1]

18) How to Solve Concurrent Request Database Performance Issues [ID 863780.1]

19) How To Get Level 12 Trace And FND Debug File For Concurrent Programs [ID 726039.1]

20) How To Print Concurrent Requests in PDF Format [ID 333504.1]

21) When Submitting Create Accounting Program It Completes With Warning "Setting the Profile Option Concurrent: OPP Response Timeout to a Higher Value May Be Necessary" [ID 553320.1]

22) Troubleshooting AutoInvoice: Concurrent Request Failures (Request Status = Error) [ID 1082238.1]

23) How To Create A Custom Concurrent Program With Host Method and Pass Parameters To The Shell Script [ID 266268.1]

24) How to Submit a Concurrent Request With CONCSUB Using a User Other Than APPS [ID 1050415.1]

25) How To Gather Statistics On Oracle Applications 11.5.10(and above) - Concurrent Process,Temp Tables, Manually [ID 419728.1]

26) Where Is 'Delete Data From Temporary Table' Concurrent Program - ICXDLTMP.SQL [ID 397118.1]

27) Error ORA-20100 .tmp Creation For FND_FILE Failed In FA Concurrent Requests [ID 392635.1]

28) Concurrent Requests Fail with FDPSTP failed due to ORA-20100: File o0002712.tmp creation for FND_FILE [ID 148262.1]

29) Concurrent Requests Complete with ORACLE Error 20100 in FDPSTP [ID 157756.1]

30) Ora-01555 Caused By SELECT Statements With Low Query Duration and no Concurrent DML [ID 361992.1]

31) ORA-20100 & ORA-6512 When Running a Concurrent Process [ID 123977.1]

32) How to Find Database Session & Process Associated with a Concurrent Program Which is Currently Running. [ID 735119.1]

33) How to Solve Concurrent Request Database Performance Issues [ID 863780.1]

34) How to move Concurrent Processing Server from one node to another node [ID 373611.1]

35) A closer examination of the Concurrent Program Purge Obsolete Workflow Runtime Data [ID 337923.1]

36) Concurrent Managers Will Only Start on One Node in PCP/RAC Environment [ID 264296.1]

37) How to Solve Concurrent Request Database Performance Issues [ID 863780.1]

38) How to Submit a Concurrent Request With CONCSUB Using a User Other Than APPS [ID 1050415.1]

39) How To Create A Custom Concurrent Program With Host Method and Pass Parameters To The Shell Script [ID 266268.1]

40) Troubleshooting AutoInvoice: Concurrent Request Failures (Request Status = Error) [ID 1082238.1]

41) When Submitting Create Accounting Program It Completes With Warning "Setting the Profile Option Concurrent: OPP Response Timeout to a Higher Value May Be Necessary" [ID 553320.1]

Hope this helps !!!!

Saturday, April 24, 2010

Notification Mailer Issue - Unable to approve/reject leave/PO using Outlook

Hello All,

Few days back , HRMS Team enabled the functionality to Approve/Reject the Employee's Leave through Mail ; But the User started complaining that the functionality is not working for few employees.

So after analysing the issue, we found out that the employees/managers who approve/reject the leave through "Webmail" were able to approve/reject the leave ; The employees/manager who use Outlook were able to view the Approve / Reject buttons but functionality was not working.

So after drilling down the issue , we have found that the one of the "Template" was not supporting the Outlook Header.
To fix the issue , we changed the Template "Open Notification (Direct Response Parsing)" to "Workflow Open Mail (Direct)" and bounced the Notification Mailer.

Navigation :
Login as Sysadmin > System Administration > OAM > Notification Mailer > Edit > Advanced > Step 4 of 8 > Templates section.

Thanks to metalink... :)

Sunday, April 4, 2010

Unable to login into ERP through SSO -- 500 Internal Server Error

Hi All,

Few days back , Users started complaining that they are unable to login into ERP.

Our Current Setup :
When the user enters the credentials , it is authenticated by IDM [with Sun LDAP ] and generates the token and once IDM authenticates , the request is forwarded to OID with the token , OID accepts the token and checks the user accounts in OID.

Error :
When the User enters the login details in SSO page, we used to get token , but also the error "500 Internal Server Error".

Error in ssoServer.log :
[ERROR] AJPRequestHandler-ApplicationServerThread-5 Audit log insertion exception: ORA-01536: space quota exceeded for tablespace 'IAS_META'
ORA-06512: at "ORASSO.WWSSO_AUDIT_LOG", line 248
ORA-06512: at "ORASSO.WWSSO_AUDIT_LOG", line 203
ORA-06512: at line 1



Cause :
The default schema , ORASSO allocated quota on tablespace was full , which didnt allow users to login into ERP.
Unable to execute/trigger the procedure "ORASSO.WWSSO_AUDIT_LOG" .

The ORASSO.WWSSO_AUDIT_LOG_TABLE_T table keeps track of SSO transactions in the Oracle Portal.
The WWSSO_AUDIT_LOG_TABLE_T table is very useful and is owned by the ORASSO user. It contains very important information about the Single Sign On transactions.


Solution:
We checked the Apache log file , it showed us the message of received token , but no error.
So , we changed the quota to unlimited , which resolved the issue.

-Avadhut

Saturday, January 2, 2010

Forms runaway processes used to consume the CPU 100%

Hi All,

Here we have Two Application nodes and user requests are controlled by hardware load balancer.

Few days back , the OS team complained us about the CPU 100% utilization by frmweb processes on both the servers.

Issue :
frmweb process are consuming 100%CPU utilization on the Server thereby increasing the load .

viz: On Oracle Applications R12 when checking the top processes on the OS level for the middle tier, you find that forms process (frmweb) almost consumes 100% of the CPU.


Cause :
The root cause of the issue is that returning rows from LOVs in core forms causes the forms process to grow up into memory depending on the number of rows returned.


When an end user login to forms and start working with LOV within core forms sometimes and according to the search criteria that the user will provide to filter the results in LOV, it may fetch huge numbers of records in which causes the frmweb process to grow very large, and in extreme cases this can even lock up the current process or even the whole machine.

So when executing a LOV query, every row is fetched into memory on the middle tier, the frmweb process can get extremely large, and the larger it gets the more likely it is to start paging.


Eventually it starts consuming excessive CPU just paging the process in and out of memory, which is probably what you can see here in this case as the amount of memory consumed when the LOV records are fetched into memory obviously depends on the amount of data in each record.


viz : The forms runaway processes used to consume the CPU %.


Solution:


IMP :: Bring down all the application services.

1- For Forms Variable "FORMS_CATCHTERM" the context vairable name is: "s_forms_catchterm" and you can update the context file located in ($INST_TOP/appl/admin/<SID_HOSTNAME.xml>)

2- For other forms variable "FORMS_RECORD_GROUP_MAX" there is no variable defined in Autoconfig for that one and have to customize the autoconfig for the forms variables to set that environment as following:


a- Go to the autoconfig Template folder:


$cd $AD_TOP/admin/template


b- Create new directory named (custom)


$ mkdir custom


c- Make sure that new directory has same file permissions as ($AD_TOP/admin/template)


d- Copy the following autoconfig template to the new custom directory:


$cp $AD_TOP/admin/template/APPLSYS_ux.env $AD_TOP/admin/template/custom/APPLSYS_ux.env


e- Edit the file copied file under custom directory and add the following 2 lines at the end of section:

####################################
# Oracle Forms environment variables
####################################

FORMS_RECORD_GROUP_MAX=10000
export FORMS_RECORD_GROUP_MAX

f- Save and exit from the file.


g- Next time autoconfig run, it will read the custom directory and check for any customizations there.


3. Run Autoconfig on the middle tier and make sure it is completed successfully.


4. Startup all services.

Monitor the CPU utilization on the server.

In our case ; we performed above mentioned Action plan on one server at a time; So no downtime is required ....... HURRAY !!! ;)






Refer : Forms Process (FRMWEB) Consumes 100% of CPU in Oracle Applications R12 [ID 745711.1]