What are the steps to identify connection leak when using DBCP, JDBCTemplate and ScheduledExecutor?
We are creating a Spring boot web app.
DB : JDBC Template and DBCP connection pool.
Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();
Time interval: 2 min
The code in runnable hits DB using JDBCTemplate.query().
Issue: The heap usage increases to several GBs in few min.
Any Pointers would be helpful to identify the memory leak.
Note: If we comment the JDBCTemplate.query() , memory usage is constant.
Settings of DBCP:
<bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="oracle.jdbc.OracleDriver" />
<property name="url" value="${batch.jdbc.url}" />
<property name="username" value="******" />
<property name="password" value="******" />
<property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />
<property name="minIdle" value="10" />
<property name="maxIdle" value="12" />
<property name="maxActive" value="100" />
<property name="accessToUnderlyingConnectionAllowed" value="true" />
<property name="initialSize" value="${batch.jdbc.pool.size}"/>
<property name="validationQuery" value="select 1 from dual" />
<property name="validationQueryTimeout" value="5" />
<property name="timeBetweenEvictionRunsMillis" value="120000" />
<property name="minEvictableIdleTimeMillis" value="60000" />
<property name="testOnBorrow" value="true" />
</bean>
Suspect from Eclipse MAT report
One instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8" occupies 1,421,543,264 (94.69%) bytes. The memory is accumulated in one instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8".
java spring spring-boot apache-commons-dbcp dbcp
edited Nov 26 at 6:14
Michael Petch
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
add a comment |
We are creating a Spring boot web app.
DB : JDBC Template and DBCP connection pool.
Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();
Time interval: 2 min
The code in runnable hits DB using JDBCTemplate.query().
Issue: The heap usage increases to several GBs in few min.
Any Pointers would be helpful to identify the memory leak.
Note: If we comment the JDBCTemplate.query() , memory usage is constant.
Settings of DBCP:
<bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="oracle.jdbc.OracleDriver" />
<property name="url" value="${batch.jdbc.url}" />
<property name="username" value="******" />
<property name="password" value="******" />
<property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />
<property name="minIdle" value="10" />
<property name="maxIdle" value="12" />
<property name="maxActive" value="100" />
<property name="accessToUnderlyingConnectionAllowed" value="true" />
<property name="initialSize" value="${batch.jdbc.pool.size}"/>
<property name="validationQuery" value="select 1 from dual" />
<property name="validationQueryTimeout" value="5" />
<property name="timeBetweenEvictionRunsMillis" value="120000" />
<property name="minEvictableIdleTimeMillis" value="60000" />
<property name="testOnBorrow" value="true" />
</bean>
Suspect from Eclipse MAT report
One instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8" occupies 1,421,543,264 (94.69%) bytes. The memory is accumulated in one instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8".
java spring spring-boot apache-commons-dbcp dbcp
edited Nov 26 at 6:14
Michael Petch
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
1
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
1
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18
add a comment |
We are creating a Spring boot web app.
DB : JDBC Template and DBCP connection pool.
Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();
Time interval: 2 min
The code in runnable hits DB using JDBCTemplate.query().
Issue: The heap usage increases to several GBs in few min.
Any Pointers would be helpful to identify the memory leak.
Note: If we comment the JDBCTemplate.query() , memory usage is constant.
Settings of DBCP:
<bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="oracle.jdbc.OracleDriver" />
<property name="url" value="${batch.jdbc.url}" />
<property name="username" value="******" />
<property name="password" value="******" />
<property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />
<property name="minIdle" value="10" />
<property name="maxIdle" value="12" />
<property name="maxActive" value="100" />
<property name="accessToUnderlyingConnectionAllowed" value="true" />
<property name="initialSize" value="${batch.jdbc.pool.size}"/>
<property name="validationQuery" value="select 1 from dual" />
<property name="validationQueryTimeout" value="5" />
<property name="timeBetweenEvictionRunsMillis" value="120000" />
<property name="minEvictableIdleTimeMillis" value="60000" />
<property name="testOnBorrow" value="true" />
</bean>
Suspect from Eclipse MAT report
One instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8" occupies 1,421,543,264 (94.69%) bytes. The memory is accumulated in one instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8".
java spring spring-boot apache-commons-dbcp dbcp
edited Nov 26 at 6:14
Michael Petch
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
We are creating a Spring boot web app.
DB : JDBC Template and DBCP connection pool.
Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();
Time interval: 2 min
The code in runnable hits DB using JDBCTemplate.query().
Issue: The heap usage increases to several GBs in few min.
Any Pointers would be helpful to identify the memory leak.
Note: If we comment the JDBCTemplate.query() , memory usage is constant.
Settings of DBCP:
<bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="oracle.jdbc.OracleDriver" />
<property name="url" value="${batch.jdbc.url}" />
<property name="username" value="******" />
<property name="password" value="******" />
<property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />
<property name="minIdle" value="10" />
<property name="maxIdle" value="12" />
<property name="maxActive" value="100" />
<property name="accessToUnderlyingConnectionAllowed" value="true" />
<property name="initialSize" value="${batch.jdbc.pool.size}"/>
<property name="validationQuery" value="select 1 from dual" />
<property name="validationQueryTimeout" value="5" />
<property name="timeBetweenEvictionRunsMillis" value="120000" />
<property name="minEvictableIdleTimeMillis" value="60000" />
<property name="testOnBorrow" value="true" />
</bean>
Suspect from Eclipse MAT report
One instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8" occupies 1,421,543,264 (94.69%) bytes. The memory is accumulated in one instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8".
java spring spring-boot apache-commons-dbcp dbcp
java spring spring-boot apache-commons-dbcp dbcp
edited Nov 26 at 6:14
Michael Petch
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
edited Nov 26 at 6:14
Michael Petch
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
edited Nov 26 at 6:14
Michael Petch
25.1k556100
edited Nov 26 at 6:14
Michael Petch
25.1k556100
edited Nov 26 at 6:14
Michael Petch
25.1k556100
25.1k556100
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
asked Nov 22 at 11:38
Vijay Kumar Chauhan
6218
6218
1
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
1
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18
add a comment |
1
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
1
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18
1
1
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
1
1
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53430156%2fwhat-are-the-steps-to-identify-connection-leak-when-using-dbcp-jdbctemplate-and%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53430156%2fwhat-are-the-steps-to-identify-connection-leak-when-using-dbcp-jdbctemplate-and%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52
1
Also what's your configuration?
– user7294900
Nov 22 at 11:53
Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07
Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18