Hi Jaromirs
The same happened to me in windows7, as soon as I set the entries() > 1_000_000
Shame as the shared map was exactly what I was looking for.
BTW same happens with ChronicleMap recompile for 1.7

java version "1.7.0_07"
Java(TM) SE Runtime Environment (build 1.7.0_07-b11)
Java HotSpot(TM) 64-Bit Server VM (build 23.3-b01, mixed mode)

from hugecollections-old.

Hi Manuel,

Peter said the guys would look into this issue: https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

from hugecollections-old.

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap
and are grateful that you are contributing to our efforts to improve the
quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes
answering the following questions:

We understand that people might have privacy concerns and that you might
not want to answer all the questions. Please don't worry if that's the
case. Also the more information we can gather the better but feel free to
write one liners if you want! You can send the answers back to me on my
private email [email protected]

1. What's the name of your company?
2. How many employees are there at the company?
3. Please describe the project in which OpenHFT software is being used
   and how it has helped.
4. Is it in evaluation or production?
5. Would you consider paying for a support model
   http://openhft.net/support/ which could include priority support,
   training, bespoke software changes.
6. How can we improve your experience with OpenHFT software?

Thanks
Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek [email protected]
wrote:

Hi Manuel,

Peter said the guys would look into this issue:
https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Hi Daniel
sure I am more than happy to share infos with you

1. Pivotal
2. 1000+
3. I am writting a post processing standalone program that need to deal
   with 25+M of entries
   The goals is to process the entries, store them in a repository and then
   let other programs accessing them
4. Evaluation
5. not sure but why not :-)
6. Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards,
Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya [email protected]
wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap
and are grateful that you are contributing to our efforts to improve the
quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes
answering the following questions:

We understand that people might have privacy concerns and that you might
not want to answer all the questions. Please don't worry if that's the
case. Also the more information we can gather the better but feel free to
write one liners if you want! You can send the answers back to me on my
private email [email protected]

1. What's the name of your company?
2. How many employees are there at the company?
3. Please describe the project in which OpenHFT software is being used
   and how it has helped.
4. Is it in evaluation or production?
5. Would you consider paying for a support model
   http://openhft.net/support/ which could include priority support,
   training, bespoke software changes.
6. How can we improve your experience with OpenHFT software?

Thanks
Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek <
[email protected]>
wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

—
Reply to this email directly or view it on GitHub
<
https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Thanks!
Can I ask for a website address for Pivotal?

Please keep in touch and let us know if there's any further way in which we
can be of assistance.

Rgds

On Wed, Sep 17, 2014 at 10:20 AM, ManuelPivotal [email protected]
wrote:

Hi Daniel
sure I am more than happy to share infos with you

1. Pivotal
2. 1000+
3. I am writting a post processing standalone program that need to deal
   with 25+M of entries
   The goals is to process the entries, store them in a repository and then
   let other programs accessing them
4. Evaluation
5. not sure but why not :-)
6. Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards,
Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya [email protected]
wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using
SharedHashMap
and are grateful that you are contributing to our efforts to improve the
quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes
answering the following questions:

We understand that people might have privacy concerns and that you might
not want to answer all the questions. Please don't worry if that's the
case. Also the more information we can gather the better but feel free
to
write one liners if you want! You can send the answers back to me on my
private email [email protected]

1. What's the name of your company?
2. How many employees are there at the company?
3. Please describe the project in which OpenHFT software is being used
   and how it has helped.
4. Is it in evaluation or production?
5. Would you consider paying for a support model
   http://openhft.net/support/ which could include priority support,
   training, bespoke software changes.
6. How can we improve your experience with OpenHFT software?

Thanks
Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek <
[email protected]>
wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

—
Reply to this email directly or view it on GitHub
<

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

—
Reply to this email directly or view it on GitHub
<
https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868554>

.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Hi Daniel,

1. DET Technologies (www.det-tech.com)
2. 6
3. We develop a trading platform called DET Hub (http://www.det-tech.com/products.html). I am not sure if you remember but we met in January in London and gave you and Peter a short demonstration.
4. We are evaluating SharedHashMap, but we already use Chronicle Queue in prod.
5. Potentially in the future. We've pushed a few commits on GitHub ourselves.
6. The same as Manuel :-) But in general we are very satisfied with the products.

Regards,
Jaromir

from hugecollections-old.

Thanks - yes I do remember - hope all is going well.

This is very helpful information.

Regards

On Wed, Sep 17, 2014 at 10:38 AM, Jaromir Satanek [email protected]
wrote:

Hi Daniel,

1. DET Technologies (www.det-tech.com)
2. 6
3. We develop a trading platform called DET Hub (
   http://www.det-tech.com/products.html). I am not sure if you remember
   but we met in January in London and gave you and Peter a short
   demonstration.
4. We are evaluating SharedHashMap, but we already use Chronicle Queue
   in prod.
5. Potentially in the future. We've pushed a few commits on GitHub
   ourselves.
6. The same as Manuel :-) But in general we are very satisfied with
   the products.

Regards,
Jaromir

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

sure
www.pivotal.io

Manuel

On Wed, Sep 17, 2014 at 10:30 AM, danielshaya [email protected]
wrote:

Thanks!
Can I ask for a website address for Pivotal?

Please keep in touch and let us know if there's any further way in which
we
can be of assistance.

Rgds

On Wed, Sep 17, 2014 at 10:20 AM, ManuelPivotal [email protected]

wrote:

Hi Daniel
sure I am more than happy to share infos with you

1. Pivotal
2. 1000+
3. I am writting a post processing standalone program that need to deal
   with 25+M of entries
   The goals is to process the entries, store them in a repository and then
   let other programs accessing them
4. Evaluation
5. not sure but why not :-)
6. Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards,
Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya [email protected]

wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using
SharedHashMap
and are grateful that you are contributing to our efforts to improve
the
quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes
answering the following questions:

We understand that people might have privacy concerns and that you
might
not want to answer all the questions. Please don't worry if that's the
case. Also the more information we can gather the better but feel free
to
write one liners if you want! You can send the answers back to me on
my
private email [email protected]

1. What's the name of your company?
2. How many employees are there at the company?
3. Please describe the project in which OpenHFT software is being used
   and how it has helped.
4. Is it in evaluation or production?
5. Would you consider paying for a support model
   http://openhft.net/support/ which could include priority support,
   training, bespoke software changes.
6. How can we improve your experience with OpenHFT software?

Thanks
Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek <
[email protected]>
wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

—
Reply to this email directly or view it on GitHub
<

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

—
Reply to this email directly or view it on GitHub
<

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868554>

.

—
Reply to this email directly or view it on GitHub
<
https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868949>

.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Sorry for the delay in fixing this issue. This issue as now been assigned, so someone will start looking at it soon.

Rob

On 17 Sep 2014, at 04:46, ManuelPivotal [email protected] wrote:

Hi Jaromirs
The same happened to me in windows7, as soon as I set the entries() > 1_000_000
Shame as the shared map was exactly what I was looking for.
BTW same happens with ChronicleMap recompile for 1.7

java version "1.7.0_07"
Java(TM) SE Runtime Environment (build 1.7.0_07-b11)
Java HotSpot(TM) 64-Bit Server VM (build 23.3-b01, mixed mode)

—
Reply to this email directly or view it on GitHub.

from hugecollections-old.

@jaromirs @ManuelPivotal I cannot reproduce the issue with locks during putting entries into so large, but succesfully constructed map. When I change the number of entries in Builder config and the insertion loop, the test is either finish succesfully or fail on map construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and value, 1 byte for writing key length and 1 for value length = 18 bytes is enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may be the cause of the difference in behaviour on Linux and Windows. But I'm not sure, because I actually couldn't reproduce your crash scenario during locking.

from hugecollections-old.

Hi Roman
Thanks for your asnwer
May be it is a incorrect use on my side then?

The code crashing is

@test public void bigMap() throws Exception { final long mapSize =
10_000_000; final String name = "/tmp/shm-test/myfile.dat"; File file = new
File(name); if (file.exists()) { file.delete(); } final
SharedHashMap<String, String> map = new SharedHashMapBuilder()
.entries(mapSize) .minSegments(128) .file(file) .kClass(String.class)
.vClass(String.class) .create(); for (long i = 0; i < mapSize; ++i) {
String s = String.valueOf(i); map.put(s, s); if(i % 50_000 == 0) {
System.out.println(String.format("Total put is %,d", totalPut)); } } }

and I've attached a minidump

I am on windows 7 enterprise, build 7601 SP1

On Wed, Sep 17, 2014 at 3:03 PM, Roman Leventov [email protected]
wrote:

@jaromirs https://github.com/jaromirs @ManuelPivotal
https://github.com/ManuelPivotal I cannot reproduce the issue with
locks during putting entries into so large, but succesfully constructed
map. When I change the number of entries in Builder config and the
insertion loop, the test is either finish succesfully or fail on map
construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up
to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and
value, 1 byte for writing key length and 1 for value length = 18 bytes is
enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may
be the cause of the difference in behaviour on Linux and Windows. But I'm
not sure, because I actually couldn't reproduce your crash scenario during
locking.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Thanks for the sample code, we will try to reproduce the issue from this.

On 17 Sep 2014, at 10:31, ManuelPivotal [email protected] wrote:

Hi Roman
Thanks for your asnwer
May be it is a incorrect use on my side then?

The code crashing is

@test public void bigMap() throws Exception { final long mapSize =
10_000_000; final String name = "/tmp/shm-test/myfile.dat"; File file = new
File(name); if (file.exists()) { file.delete(); } final
SharedHashMap<String, String> map = new SharedHashMapBuilder()
.entries(mapSize) .minSegments(128) .file(file) .kClass(String.class)
.vClass(String.class) .create(); for (long i = 0; i < mapSize; ++i) {
String s = String.valueOf(i); map.put(s, s); if(i % 50_000 == 0) {
System.out.println(String.format("Total put is %,d", totalPut)); } } }

and I've attached a minidump

I am on windows 7 enterprise, build 7601 SP1

On Wed, Sep 17, 2014 at 3:03 PM, Roman Leventov [email protected]
wrote:

@jaromirs https://github.com/jaromirs @ManuelPivotal
https://github.com/ManuelPivotal I cannot reproduce the issue with
locks during putting entries into so large, but succesfully constructed
map. When I change the number of entries in Builder config and the
insertion loop, the test is either finish succesfully or fail on map
construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up
to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and
value, 1 byte for writing key length and 1 for value length = 18 bytes is
enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may
be the cause of the difference in behaviour on Linux and Windows. But I'm
not sure, because I actually couldn't reproduce your crash scenario during
locking.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

—
Reply to this email directly or view it on GitHub.

from hugecollections-old.

@ManuelPivotal your test performs equally uninteresting on my Windows machine: fail on map creation or success, depending on the map size. When I configured NO_ALIGNMENT and entrySize = 18 the map started to consume really not very much memory and the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is meaningful:
--------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64 JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++ 10.0 (VS2010)

from hugecollections-old.

@roman
Here is the dump, I suppose github get rid of it :-)

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on client

versions of Windows

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm,
id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers:
RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c,
RDX=0x00000000029adae8
RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065,
RDI=0x00000000493f5d40
R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c,
R11=0x0000000066602040
R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8,
R15=0x00000000025ae800
RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10)
0x00000000029ada10: 00000000029ada60 000000077d3e0830
0x00000000029ada20: 0000000000000000 00000000665d18d1
0x00000000029ada30: 00000000029b6374 00000000029c23a8
0x00000000029ada40: 000000077cad5240 00000000029adab8
0x00000000029ada50: 00000000efa75065 00000000029c28d9
0x00000000029ada60: 000000077cad6eb0 00000000029adac8
0x00000000029ada70: 00000000efa75065 00000000029ada78
0x00000000029ada80: 0000000000000000 00000000029adae8
0x00000000029ada90: 000000077cad9230 0000000000000000
0x00000000029adaa0: 000000077cad5240 0000000000000000
0x00000000029adab0: 00000000029adad8 00000000029adb30
0x00000000029adac0: 00000000029b64f0 0000000000000000
0x00000000029adad0: 00000000029bf1ce 00000000493f5d40
0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8
0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1
0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86)
0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f
0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01
0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b
0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

Register to memory mapping:

RAX=0x00000000025ae800 is a thread
RBX=0x00000000025ae800 is a thread
RCX=0x000000000000000c is an unknown value
RDX=0x00000000029adae8 is pointing into the stack for thread:
0x00000000025ae800
RSP=0x00000000029ada10 is pointing into the stack for thread:
0x00000000025ae800
RBP=0x00000000029adab8 is pointing into the stack for thread:
0x00000000025ae800
RSI=0x00000000efa75065 is an unknown value
RDI=0x00000000493f5d40 is an unknown value
R8 =0x00000000493f5d40 is an unknown value
R9 =0x00000007d730a128 is an oop
java.lang.Class

• klass: 'java/lang/Class'
  R10=0x00000000029c237c is an Interpreter codelet
  method entry point (kind = native) [0x00000000029c2100,
  0x00000000029c2980] 2176 bytes
  R11=0x0000000066602040 is an unknown value
  R12=0x0000000000000000 is an unknown value
  R13=0x000000077cad5240 is an oop
  {method}
• klass: {other class}
  R14=0x00000000029adae8 is pointing into the stack for thread:
  0x00000000025ae800
  R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10,
free space=1014k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V [jvm.dll+0x193d86]
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48
j
net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7
j
net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58
j
net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52
j
net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80
j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.misc.Unsafe.getByte(J)B+0
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48
j
net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7
j
net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58
j
net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52
j
net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80
j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
j
sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0
j
sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87
j
sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6
j
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57
j
org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242
j
org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292
j
org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46
j
org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762
j
org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32
j org.testng.internal.TestMethodWorker.run()V+60
j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356
j org.testng.TestRunner.run()V+26
j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1
j org.testng.SuiteRunner.runSequentially()V+31
j org.testng.SuiteRunner.privateRun()V+281
j org.testng.SuiteRunner.run()V+6
j
org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89
j org.testng.SuiteRunnerWorker.run()V+12
j
org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66
j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143
j org.testng.TestNG.run()V+77
j org.testng.remote.RemoteTestNG.run()V+204
j
org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171
j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native, id=3816,
stack(0x000000000e260000,0x000000000e360000)]
0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked,
id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)]
0x000000000be32800 JavaThread "C2 CompilerThread1" daemon
[_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)]
0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon
[_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)]
0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked,
id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)]
0x000000000be22800 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)]
0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked,
id=5712, stack(0x000000000d130000,0x000000000d230000)]
0x00000000026a4000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)]
=>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744,
stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads:
0x000000000bda2000 VMThread [stack:
0x000000000ce30000,0x000000000cf30000] [id=3608]
0x000000000be44000 WatcherThread [stack:
0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000,
0x00000007d88c0000, 0x0000000800000000)
eden space 32320K, 66% used
[0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000)
from space 5376K, 0% used
[0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000)
to space 5376K, 0% used
[0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000)
ParOldGen total 86144K, used 0K [0x0000000781c00000,
0x0000000787020000, 0x00000007d5eb0000)
object space 86144K, 0% used
[0x0000000781c00000,0x0000000781c00000,0x0000000787020000)
PSPermGen total 21248K, used 10190K [0x000000077ca00000,
0x000000077dec0000, 0x0000000781c00000)
object space 21248K, 47% used
[0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000] byte_map_base:
0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000)
total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb
largest_free_block=49725568

Compilation events (10 events):
Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0 code
[0x0000000002a34200, 0x0000000002a34278]
Event: 0.624 Thread 0x000000000be2c800 54
java.lang.reflect.Method::getName (5 bytes)
Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0 code
[0x0000000002a34000, 0x0000000002a34078]
Event: 0.624 Thread 0x000000000be2c800 55
java.util.HashMap::get (29 bytes)
Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0 code
[0x0000000002a33a40, 0x0000000002a33c78]
Event: 0.627 Thread 0x000000000be2c800 56
java.lang.StringBuilder::append (8 bytes)
Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310 code
[0x0000000002a33460, 0x0000000002a33608]
Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0 code
[0x0000000002a3dce0, 0x0000000002a40290]
Event: 0.675 Thread 0x000000000be2c800 57
java.util.Arrays::copyOf (19 bytes)
Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10 code
[0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events):
No events

Deoptimization events (1 events):
Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc
0x0000000002a16db8

Internal exceptions (10 events):
Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events):
Event: 0.697 loading class 0x0000000002691e30
Event: 0.697 loading class 0x0000000002691e30 done
Event: 0.699 loading class 0x000000000eb44440
Event: 0.699 loading class 0x000000000eb44440 done
Event: 0.700 loading class 0x000000000ef2c5f0
Event: 0.700 loading class 0x000000000ef2c5f0 done
Event: 0.700 loading class 0x000000000eb44b00
Event: 0.700 loading class 0x000000000eb44b00 done
Event: 0.702 loading class 0x000000000ef2c460
Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries:
0x000000013f8b0000 - 0x000000013f8e4000
C:\devs\Java\jdk1.7.0_07\bin\javaw.exe
0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll
0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll
0x000007fefd4e0000 - 0x000007fefd54c000 C:\Windows\system32\KERNELBASE.dll
0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll
0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll
0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll
0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll
0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll
0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll
0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll
0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll
0x000007fefbe60000 - 0x000007fefc054000
C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll
0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll
0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL
0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll
0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll
0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA
Corporation\CoProcManager_etoured.dll
0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvd3d9wrapx.dll
0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll
0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll
0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll
0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll
0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll
0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvdxgiwrapx.dll
0x000000006a4e0000 - 0x000000006a5b1000
C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll
0x0000000066440000 - 0x0000000066b5f000
C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll
0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll
0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll
0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll
0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll
0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL
0x000000006a4d0000 - 0x000000006a4df000
C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll
0x000000006a4a0000 - 0x000000006a4c8000
C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll
0x000000006a300000 - 0x000000006a315000
C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll
0x00000000702c0000 - 0x00000000702d9000
C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll
0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll
0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll
0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll
0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll
0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL
0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL
0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll
0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll
0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll
0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll
0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll
0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll
0x000007fefd150000 - 0x000007fefd15f000 C:\Windows\system32\CRYPTBASE.dll
0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll
0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll
0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll
0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll
0x000000006b2e0000 - 0x000000006b2f1000
C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll
0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments:
jvm_args: -ea -Dfile.encoding=Cp1252
java_command: org.testng.remote.RemoteTestNG -serport 42246 -d
C:\devs\workspaces\use-case\smartcities-postprocess\test-output
C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\devs\Java\jdk1.7.0_07
CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip
PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;"C:\Program
Files (x86)\Common
Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program
Files (x86)\QuickTime\QTSystem;C:\Program Files (x86)\Nmap
USERNAME=meyerm4
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42
stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2,
popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap 16536160k(11979168k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64 JRE
(1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown MS
VC++:1600

time: Wed Sep 17 15:29:56 2014
elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov [email protected]
wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs
equally uninteresting on my Windows machine: fail on map creation or
success, depending on the map size. When I configured NO_ALIGNMENT and
entrySize = 18 the map started to consume really not very much memory and
the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is
meaningful:
--------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10
stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext,
3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64
JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++
10.0 (VS2010)

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

@ManuelPivotal you have the same crash reason as me -- lack of memory. Just configure entrySize and alignment and it should disappear. Or use a machine with more memory :) Jaromirs's case is more puzzling....

from hugecollections-old.

@roman
Thanks, I set your parameters and could run the test with 30_000_000 !
Very promising :-)

Thanks a lot for your help

Manuel

On Wed, Sep 17, 2014 at 4:47 PM, Roman Leventov [email protected]
wrote:

@ManuelPivotal https://github.com/ManuelPivotal you have the same crash
reason as me -- lack of memory. Just configure entrySize and alignment and
it should disappear. Or use a machine with more memory :) Jaromirs's case
is more puzzling....

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

JRE version: 7.0_07-b11

I would suggest updating this version of Java 7 update 67 as update 7 is
pretty old. (If not Java 8)
I don't think it would make any difference to your problem, but there have
been a lot of bugs fixed since then.

On 17 September 2014 16:41, ManuelPivotal [email protected] wrote:

@roman
Here is the dump, I suppose github get rid of it :-)

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on

client
versions of Windows

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm,
id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers:
RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c,
RDX=0x00000000029adae8
RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065,
RDI=0x00000000493f5d40
R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c,
R11=0x0000000066602040
R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8,
R15=0x00000000025ae800
RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10)
0x00000000029ada10: 00000000029ada60 000000077d3e0830
0x00000000029ada20: 0000000000000000 00000000665d18d1
0x00000000029ada30: 00000000029b6374 00000000029c23a8
0x00000000029ada40: 000000077cad5240 00000000029adab8
0x00000000029ada50: 00000000efa75065 00000000029c28d9
0x00000000029ada60: 000000077cad6eb0 00000000029adac8
0x00000000029ada70: 00000000efa75065 00000000029ada78
0x00000000029ada80: 0000000000000000 00000000029adae8
0x00000000029ada90: 000000077cad9230 0000000000000000
0x00000000029adaa0: 000000077cad5240 0000000000000000
0x00000000029adab0: 00000000029adad8 00000000029adb30
0x00000000029adac0: 00000000029b64f0 0000000000000000
0x00000000029adad0: 00000000029bf1ce 00000000493f5d40
0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8
0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1
0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86)
0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f
0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01
0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b
0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

Register to memory mapping:

RAX=0x00000000025ae800 is a thread
RBX=0x00000000025ae800 is a thread
RCX=0x000000000000000c is an unknown value
RDX=0x00000000029adae8 is pointing into the stack for thread:
0x00000000025ae800
RSP=0x00000000029ada10 is pointing into the stack for thread:
0x00000000025ae800
RBP=0x00000000029adab8 is pointing into the stack for thread:
0x00000000025ae800
RSI=0x00000000efa75065 is an unknown value
RDI=0x00000000493f5d40 is an unknown value
R8 =0x00000000493f5d40 is an unknown value
R9 =0x00000007d730a128 is an oop
java.lang.Class

• klass: 'java/lang/Class'
  R10=0x00000000029c237c is an Interpreter codelet
  method entry point (kind = native) [0x00000000029c2100,
  0x00000000029c2980] 2176 bytes
  R11=0x0000000066602040 is an unknown value
  R12=0x0000000000000000 is an unknown value
  R13=0x000000077cad5240 is an oop
  {method}
• klass: {other class}
  R14=0x00000000029adae8 is pointing into the stack for thread:
  0x00000000025ae800
  R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10,
free space=1014k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V [jvm.dll+0x193d86]
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j
net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j
net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j
net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j
net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.misc.Unsafe.getByte(J)B+0
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j
net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j
net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j
net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j
net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j
net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
j
sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0

j
sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87

j
sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6

j
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57

j
org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242

j
org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292

j
org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46

j
org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762

j
org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32

j org.testng.internal.TestMethodWorker.run()V+60
j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356
j org.testng.TestRunner.run()V+26
j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1
j org.testng.SuiteRunner.runSequentially()V+31
j org.testng.SuiteRunner.privateRun()V+281
j org.testng.SuiteRunner.run()V+6
j
org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89

j org.testng.SuiteRunnerWorker.run()V+12
j
org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66

j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143
j org.testng.TestNG.run()V+77
j org.testng.remote.RemoteTestNG.run()V+204
j
org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171

j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native, id=3816,
stack(0x000000000e260000,0x000000000e360000)]
0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked,
id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)]
0x000000000be32800 JavaThread "C2 CompilerThread1" daemon
[_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)]
0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon
[_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)]
0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked,
id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)]
0x000000000be22800 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)]
0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked,
id=5712, stack(0x000000000d130000,0x000000000d230000)]
0x00000000026a4000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)]
=>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744,
stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads:
0x000000000bda2000 VMThread [stack:
0x000000000ce30000,0x000000000cf30000] [id=3608]
0x000000000be44000 WatcherThread [stack:
0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000,
0x00000007d88c0000, 0x0000000800000000)
eden space 32320K, 66% used
[0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000)
from space 5376K, 0% used
[0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000)
to space 5376K, 0% used
[0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000)
ParOldGen total 86144K, used 0K [0x0000000781c00000,
0x0000000787020000, 0x00000007d5eb0000)
object space 86144K, 0% used
[0x0000000781c00000,0x0000000781c00000,0x0000000787020000)
PSPermGen total 21248K, used 10190K [0x000000077ca00000,
0x000000077dec0000, 0x0000000781c00000)
object space 21248K, 47% used
[0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000]
byte_map_base:
0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000)
total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb
largest_free_block=49725568

Compilation events (10 events):
Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0 code
[0x0000000002a34200, 0x0000000002a34278]
Event: 0.624 Thread 0x000000000be2c800 54
java.lang.reflect.Method::getName (5 bytes)
Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0 code
[0x0000000002a34000, 0x0000000002a34078]
Event: 0.624 Thread 0x000000000be2c800 55
java.util.HashMap::get (29 bytes)
Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0 code
[0x0000000002a33a40, 0x0000000002a33c78]
Event: 0.627 Thread 0x000000000be2c800 56
java.lang.StringBuilder::append (8 bytes)
Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310 code
[0x0000000002a33460, 0x0000000002a33608]
Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0 code
[0x0000000002a3dce0, 0x0000000002a40290]
Event: 0.675 Thread 0x000000000be2c800 57
java.util.Arrays::copyOf (19 bytes)
Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10 code
[0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events):
No events

Deoptimization events (1 events):
Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc
0x0000000002a16db8

Internal exceptions (10 events):
Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events):
Event: 0.697 loading class 0x0000000002691e30
Event: 0.697 loading class 0x0000000002691e30 done
Event: 0.699 loading class 0x000000000eb44440
Event: 0.699 loading class 0x000000000eb44440 done
Event: 0.700 loading class 0x000000000ef2c5f0
Event: 0.700 loading class 0x000000000ef2c5f0 done
Event: 0.700 loading class 0x000000000eb44b00
Event: 0.700 loading class 0x000000000eb44b00 done
Event: 0.702 loading class 0x000000000ef2c460
Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries:
0x000000013f8b0000 - 0x000000013f8e4000
C:\devs\Java\jdk1.7.0_07\bin\javaw.exe
0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll
0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll
0x000007fefd4e0000 - 0x000007fefd54c000 C:\Windows\system32\KERNELBASE.dll
0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll
0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll
0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll
0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll
0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll
0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll
0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll
0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll
0x000007fefbe60000 - 0x000007fefc054000
C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll

0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll
0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL
0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll
0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll
0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA
Corporation\CoProcManager_etoured.dll
0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvd3d9wrapx.dll
0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll
0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll
0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll
0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll
0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll
0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvdxgiwrapx.dll
0x000000006a4e0000 - 0x000000006a5b1000
C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll
0x0000000066440000 - 0x0000000066b5f000
C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll
0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll
0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll
0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll
0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll
0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL
0x000000006a4d0000 - 0x000000006a4df000
C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll
0x000000006a4a0000 - 0x000000006a4c8000
C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll
0x000000006a300000 - 0x000000006a315000
C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll
0x00000000702c0000 - 0x00000000702d9000
C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll
0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll
0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll
0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll
0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll
0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL
0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL
0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll
0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll
0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll
0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll
0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll
0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll
0x000007fefd150000 - 0x000007fefd15f000 C:\Windows\system32\CRYPTBASE.dll
0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll
0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll
0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll
0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll
0x000000006b2e0000 - 0x000000006b2f1000
C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll
0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments:
jvm_args: -ea -Dfile.encoding=Cp1252
java_command: org.testng.remote.RemoteTestNG -serport 42246 -d
C:\devs\workspaces\use-case\smartcities-postprocess\test-output
C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml

Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\devs\Java\jdk1.7.0_07
CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip
PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;"C:\Program

Files (x86)\Common
Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program

Files (x86)\QuickTime\QTSystem;C:\Program Files (x86)\Nmap
USERNAME=meyerm4
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42
stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2,
popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap
16536160k(11979168k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64
JRE
(1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown MS
VC++:1600

time: Wed Sep 17 15:29:56 2014
elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov [email protected]

wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs
equally uninteresting on my Windows machine: fail on map creation or
success, depending on the map size. When I configured NO_ALIGNMENT and
entrySize = 18 the map started to consume really not very much memory
and
the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is
meaningful:
--------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10
stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext,
3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap
8386100k(2447272k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64
JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS
VC++
10.0 (VS2010)

—
Reply to this email directly or view it on GitHub
<
https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55908842>

.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Hi Peter
I agree but unfortunately the production target box is running this
version... :-)

Regards,
Manuel

On Wed, Sep 17, 2014 at 5:12 PM, Peter Lawrey [email protected]
wrote:

JRE version: 7.0_07-b11

I would suggest updating this version of Java 7 update 67 as update 7 is
pretty old. (If not Java 8)
I don't think it would make any difference to your problem, but there have
been a lot of bugs fixed since then.

On 17 September 2014 16:41, ManuelPivotal [email protected]
wrote:

@roman
Here is the dump, I suppose github get rid of it :-)

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on

client
versions of Windows

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm,
id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers:
RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c,
RDX=0x00000000029adae8
RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065,
RDI=0x00000000493f5d40
R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c,
R11=0x0000000066602040
R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8,
R15=0x00000000025ae800
RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10)
0x00000000029ada10: 00000000029ada60 000000077d3e0830
0x00000000029ada20: 0000000000000000 00000000665d18d1
0x00000000029ada30: 00000000029b6374 00000000029c23a8
0x00000000029ada40: 000000077cad5240 00000000029adab8
0x00000000029ada50: 00000000efa75065 00000000029c28d9
0x00000000029ada60: 000000077cad6eb0 00000000029adac8
0x00000000029ada70: 00000000efa75065 00000000029ada78
0x00000000029ada80: 0000000000000000 00000000029adae8
0x00000000029ada90: 000000077cad9230 0000000000000000
0x00000000029adaa0: 000000077cad5240 0000000000000000
0x00000000029adab0: 00000000029adad8 00000000029adb30
0x00000000029adac0: 00000000029b64f0 0000000000000000
0x00000000029adad0: 00000000029bf1ce 00000000493f5d40
0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8
0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1
0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86)
0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f
0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01
0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b
0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

Register to memory mapping:

RAX=0x00000000025ae800 is a thread
RBX=0x00000000025ae800 is a thread
RCX=0x000000000000000c is an unknown value
RDX=0x00000000029adae8 is pointing into the stack for thread:
0x00000000025ae800
RSP=0x00000000029ada10 is pointing into the stack for thread:
0x00000000025ae800
RBP=0x00000000029adab8 is pointing into the stack for thread:
0x00000000025ae800
RSI=0x00000000efa75065 is an unknown value
RDI=0x00000000493f5d40 is an unknown value
R8 =0x00000000493f5d40 is an unknown value
R9 =0x00000007d730a128 is an oop
java.lang.Class

• klass: 'java/lang/Class'
  R10=0x00000000029c237c is an Interpreter codelet
  method entry point (kind = native) [0x00000000029c2100,
  0x00000000029c2980] 2176 bytes
  R11=0x0000000066602040 is an unknown value
  R12=0x0000000000000000 is an unknown value
  R13=0x000000077cad5240 is an oop
  {method}
• klass: {other class}
  R14=0x00000000029adae8 is pointing into the stack for thread:
  0x00000000025ae800
  R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10,
free space=1014k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native
code)
V [jvm.dll+0x193d86]
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j

net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j

net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j

net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j

net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.misc.Unsafe.getByte(J)B+0
j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25
j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j

net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j

net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j

net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j

net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66
v ~StubRoutines::call_stub
j

sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0

j

sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87

j

sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6

j

java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57

j

org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242

j

org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292

j

org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46

j

org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762

j

org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32

j org.testng.internal.TestMethodWorker.run()V+60
j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356
j org.testng.TestRunner.run()V+26
j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1
j org.testng.SuiteRunner.runSequentially()V+31
j org.testng.SuiteRunner.privateRun()V+281
j org.testng.SuiteRunner.run()V+6
j

org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89

j org.testng.SuiteRunnerWorker.run()V+12
j

org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66

j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143
j org.testng.TestNG.run()V+77
j org.testng.remote.RemoteTestNG.run()V+204
j

org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171

j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native,
id=3816,
stack(0x000000000e260000,0x000000000e360000)]
0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked,
id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)]
0x000000000be32800 JavaThread "C2 CompilerThread1" daemon
[_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)]
0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon
[_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)]
0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked,
id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)]
0x000000000be22800 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)]
0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked,
id=5712, stack(0x000000000d130000,0x000000000d230000)]
0x00000000026a4000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)]
=>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744,
stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads:
0x000000000bda2000 VMThread [stack:
0x000000000ce30000,0x000000000cf30000] [id=3608]
0x000000000be44000 WatcherThread [stack:
0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000,
0x00000007d88c0000, 0x0000000800000000)
eden space 32320K, 66% used
[0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000)
from space 5376K, 0% used
[0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000)
to space 5376K, 0% used
[0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000)
ParOldGen total 86144K, used 0K [0x0000000781c00000,
0x0000000787020000, 0x00000007d5eb0000)
object space 86144K, 0% used
[0x0000000781c00000,0x0000000781c00000,0x0000000787020000)
PSPermGen total 21248K, used 10190K [0x000000077ca00000,
0x000000077dec0000, 0x0000000781c00000)
object space 21248K, 47% used
[0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000]
byte_map_base:
0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000)
total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb
largest_free_block=49725568

Compilation events (10 events):
Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0
code
[0x0000000002a34200, 0x0000000002a34278]
Event: 0.624 Thread 0x000000000be2c800 54
java.lang.reflect.Method::getName (5 bytes)
Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0
code
[0x0000000002a34000, 0x0000000002a34078]
Event: 0.624 Thread 0x000000000be2c800 55
java.util.HashMap::get (29 bytes)
Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0
code
[0x0000000002a33a40, 0x0000000002a33c78]
Event: 0.627 Thread 0x000000000be2c800 56
java.lang.StringBuilder::append (8 bytes)
Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310
code
[0x0000000002a33460, 0x0000000002a33608]
Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0
code
[0x0000000002a3dce0, 0x0000000002a40290]
Event: 0.675 Thread 0x000000000be2c800 57
java.util.Arrays::copyOf (19 bytes)
Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10
code
[0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events):
No events

Deoptimization events (1 events):
Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc
0x0000000002a16db8

Internal exceptions (10 events):
Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166
Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at
C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events):
Event: 0.697 loading class 0x0000000002691e30
Event: 0.697 loading class 0x0000000002691e30 done
Event: 0.699 loading class 0x000000000eb44440
Event: 0.699 loading class 0x000000000eb44440 done
Event: 0.700 loading class 0x000000000ef2c5f0
Event: 0.700 loading class 0x000000000ef2c5f0 done
Event: 0.700 loading class 0x000000000eb44b00
Event: 0.700 loading class 0x000000000eb44b00 done
Event: 0.702 loading class 0x000000000ef2c460
Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries:
0x000000013f8b0000 - 0x000000013f8e4000
C:\devs\Java\jdk1.7.0_07\bin\javaw.exe
0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll
0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll
0x000007fefd4e0000 - 0x000007fefd54c000
C:\Windows\system32\KERNELBASE.dll
0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll
0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll
0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll
0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll
0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll
0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll
0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll
0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll
0x000007fefbe60000 - 0x000007fefc054000

C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll

0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll
0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL
0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll
0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll
0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA
Corporation\CoProcManager_etoured.dll
0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvd3d9wrapx.dll
0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll
0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll
0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll
0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll
0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll
0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA
Corporation\CoProcManager\nvdxgiwrapx.dll
0x000000006a4e0000 - 0x000000006a5b1000
C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll
0x0000000066440000 - 0x0000000066b5f000
C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll
0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll
0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll
0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll
0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll
0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL
0x000000006a4d0000 - 0x000000006a4df000
C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll
0x000000006a4a0000 - 0x000000006a4c8000
C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll
0x000000006a300000 - 0x000000006a315000
C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll
0x00000000702c0000 - 0x00000000702d9000
C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll
0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll
0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll
0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll
0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll
0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL
0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL
0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll
0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll
0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll
0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll
0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll
0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll
0x000007fefd150000 - 0x000007fefd15f000
C:\Windows\system32\CRYPTBASE.dll
0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll
0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll
0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll
0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll
0x000000006b2e0000 - 0x000000006b2f1000
C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll
0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments:
jvm_args: -ea -Dfile.encoding=Cp1252
java_command: org.testng.remote.RemoteTestNG -serport 42246 -d
C:\devs\workspaces\use-case\smartcities-postprocess\test-output

C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml

Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\devs\Java\jdk1.7.0_07
CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip

PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;"C:\Program

Files (x86)\Common

Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program

Files (x86)\QuickTime\QTSystem;C:\Program Files (x86)\Nmap
USERNAME=meyerm4
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42
stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1,
sse4.2,
popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap
16536160k(11979168k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64
JRE
(1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown
MS
VC++:1600

time: Wed Sep 17 15:29:56 2014
elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov <
[email protected]>

wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs
equally uninteresting on my Windows machine: fail on map creation or
success, depending on the map size. When I configured NO_ALIGNMENT and
entrySize = 18 the map started to consume really not very much memory
and
the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is
meaningful:
--------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10
stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext,
3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap
8386100k(2447272k
free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for
windows-amd64
JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS
VC++
10.0 (VS2010)

—
Reply to this email directly or view it on GitHub
<

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55908842>

.

—
Reply to this email directly or view it on GitHub
<
https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55913394>

.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

@ManuelPivotal if you outrun 10_000_000, your should configure 20-byte entries, because the assumption behind number 18 is that keys and values are strings representing at most 7-digit numbers.
If you run the test with size 30_000_000, two-thirds of all entries cannot fit the entry size and take two entries, which is allowed, but lead to x2 mem waste, some slowdowns and risk of map overflow.

from hugecollections-old.

if I want to map a java class with a 15 character long string as a key and
a class of let's say 1 string of 12 chars and 1 string of 64 what would be
the entrySice?
The key will have a 15 char long constantly and the value will be made of 2
strings, 1 of 12 chars and 1 of 64

On Wed, Sep 17, 2014 at 5:14 PM, Roman Leventov [email protected]
wrote:

@ManuelPivotal https://github.com/ManuelPivotal if you outrun
10_000_000, your should configure 20-byte entries, because the assumption
behind number 18 is that keys and values are strings representing at most
7-digit numbers.
If you run the test with size 30_000_000, two-thirds of all entries cannot
fit the entry size and take two entries, which is allowed, but lead to x2
mem waste, some slowdowns and risk of map overflow.

—
Reply to this email directly or view it on GitHub
#42 (comment)
.

from hugecollections-old.

Hi Roman,

do you need any assistance from myself? I am busy at the moment but I can try to reproduce the issue again at the weekend.

Jaromir

from hugecollections-old.

@ManuelPivotal Ordinary object header in serialized form takes 6 bytes, string headers are 3 bytes.

1 : key length + (15 + 1 : key string repr) + 1 : value length + 6 : header + (3 + 12) + (3 + 64) = 106 bytes. + 0-7 bytes depending on aligning configuration, I would set 128 bytes for any case.

Plus 10 bytes if you are going to use replication.

from hugecollections-old.

@jaromirs If you could set the appropriate entrySize and try to rerun the test on your environment, that would be very helpful, thanks.

from hugecollections-old.

Hi Roman,

I've done that (decreased entry size) and it does not crash anymore. I think I have actually the same issue as Manual - lack of memory. I've tried various combinations of entrySize and entries parameters and the issue happens if entrySize * entries > X (I am not sure about accurate value of X). The question is why the callstack says that the JVM crashed in lock method.

One interesting observation: when I use entrySize=256 and entries=15,000,000 I get the crash with second put into the map and the callstack says the issue is in lock method. When I decreased number of entries to 10,000,000 the application crashes when it tries to create the map - that is odd.

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

Thanks, Jaromir

from hugecollections-old.

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

@jaromirs yes, we just discussed this privately. It is certaily worth to do this, we will try to investigate if it is possible and do if it is.

from hugecollections-old.

we have raised https://higherfrequencytrading.atlassian.net/browse/HCOLL-143

On 21 Sep 2014, at 20:39, Roman Leventov [email protected] wrote:

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

@jaromirs yes, we just discussed this privately. It is certaily worth to do this, we will try to investigate if it is possible and do if it is.

—
Reply to this email directly or view it on GitHub.

from hugecollections-old.

@jaromirs when you get this issue, are you running in windows ?

from hugecollections-old.

Yes, it only happens on Windows.

from hugecollections-old.