Comments (5)
oschwald
commented on August 25, 2024
MaxMind databases have alias_ipv6_to_ipv4 enabled. You will need to exclude the aliased ranges in order to see a size reduction as you are currently inserting them multiple times.
from maxmind-db-writer-perl.
rmharris
commented on August 25, 2024
On 18 Dec 2018, at 22:22, Gregory Oschwald ***@***.***> wrote:
MaxMind databases have alias_ipv6_to_ipv4 enabled. You will need to exclude the aliased ranges in order to see a size reduction as you are currently inserting them multiple times.
Many thanks for the reply. Could you give me an example of what I would see from the iterator if I was passed an aliased range multiple times? I don't quite understand the context.
Robert
from maxmind-db-writer-perl.
oschwald
commented on August 25, 2024
::ffff:0:0/96, 2001::/32, and 2002::/16 are aliased to ::/96 in these databases. Unfortunately, I don't think there is a good way to tell this from the callbacks. You could just explicitly filter out subnets in these networks. Another option would be to use the CSV provided by MaxMind, which does not include them and would likely be faster.
from maxmind-db-writer-perl.
rmharris
commented on August 25, 2024
OK, but shouldn't I be able to effect the same aliasing in my new database by specifying alias_ipv6_to_ipv4 = 1 when constructing the writer?
from maxmind-db-writer-perl.
oschwald
commented on August 25, 2024
Yes, you can, but it won't let you insert into the aliased nodes, resulting in an exception. I suppose you could just catch all of those exceptions and ignore them given that it is just duplicate data.
from maxmind-db-writer-perl.
Related Issues (20)
- Merge of array values on ip collision HOT 2
- How to create large database HOT 1
- Subnets are randomly dropped on merge HOT 2
- Error message when data section exceeds the maximum size is improved (was: Corrupt data when DB is large) HOT 2
- map type: value is same with key, write failed HOT 2
- allow private IP ranges in a custom maxminddb HOT 4
- Issue in insert network where raw string work but string in some variable does not work HOT 1
- FTBFS: test failures on some architectures HOT 9
- May I ask how ipv4 and ipv6 are generated into a mmdb file HOT 3
- There is a problem when using map in map HOT 3
- IPv4 and IPv6 data conflict HOT 1
- The problem of ipv4 and ipv6 HOT 4
- Search tree duplicated via Writer has much bigger size than an original HOT 1
- Can't use string as a HASH ref in DB/Writer/Tree.pm HOT 3
- Error with example code HOT 4
- Windows support added
- MaxMind::DB::Writer Merge data in Ip ranges HOT 7
- MaxMind::DB::Writer 0.300002 fails to compile on Ubuntu 18.04 HOT 6
- Can't find appropriate typing for hashes with mixed data HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from maxmind-db-writer-perl.