Comments (12)
Let us check and fix it quickly. Thanks for reporting.
from hindex.
Is this table IndexedHTableDesc now? Can u try alter the table with IndexedHTableDesc once and then do the run of the MR?
from hindex.
Yes, after run the map/reduce job, it can create a index table. But when run the map/reduce job, it try to find the IndexHtableDesc from /tmp/hbase-${user}/${table-name}/.tableinfo path, but I cannot find it from the local machine. So it always return null.
from hindex.
From TableIndexer before running mapreduce job, we are creating index table
String tableNameToIndex = tableName[0];
IndexUtils.createIndexTable(tableNameToIndex, conf, cfs);
createMapReduceJob(tableNameToIndex, conf, caching, versions);
So there should be index table present always.
One more thing is you are using standalone hbase cluster?
This means your mapreduce job will run in local mode right?
from hindex.
- yes, though no data been put into hbase, but the index table can be create in the hbase.
2.I do not use standlone hbase cluster, I have one master and three region server, and the hadoop is also cluster mode, there are three datanode.
from hindex.
I see.
I thought its standalone mode by seeing this path /tmp/hbase-${user}/${table-name}/.tableinfo
Any way we have just now also tested. Its working fine in our case. Can you tell your configurations?
from hindex.
It return null at execute IndexUtils.getTableInfoFilePat(),
when execute
Path path = FSUtils.getTablePath(FSUtils.getRootDir(conf), tableName);
So i print the path, it output: /tmp/hbase-${user}/..../.tableinfo.
I donot know this path is hdfs or local path.
Ask a question, you will save index table desc in some tmp path?But i cannot find them both in hdfs and local machine file system.
from hindex.
which configuration do you mean? hbase cluster or map/reduce?
hbase cluster configuration just as normal.
map/reduce I extractor com.apache.hadoop.hbase.filter and com.apache.hadoop.hbase.index these two package and build the jar with
hbase.zookeeper.quorum
ubuntu-zk1
tablename.to.index
....
<property>
<name>table.columns.index</name>
<value>....</value>
<property>
<name>hbase.defaults.for.version.skip</name>
<value>true</value>
</property>
from hindex.
We are storing any thing tmp directory. Index table will be created as normal table by master.
The path is default path from hbase-default.xml
hbase.rootdir
file:///tmp/hbase-${user.name}/hbase
It should be configured in hbase-site.xml with hbase root directory in hdfs(Ex: hdfs://ip:port/hbase)
Can you check hbase-site.xml configurations are loaded properly while initializing job?
from hindex.
OK, i get the reason. I think the hbase.rootdir should be the cluster configuration, so i do not configure it in the map/reduce job. After configure it correctly, it can index the data. Sorry for that.
from hindex.
thank you very much!
from hindex.
No problem. Thanks
from hindex.
Related Issues (20)
- hindex write issues HOT 7
- Support secure access to the index tables HOT 2
- migrate hindex to hbase 0.96 or higher HOT 5
- deadlock in put operation HOT 3
- issues in put operation HOT 10
- how to use the index? HOT 8
- Error when compile with maven.
- How to use hindex for scanning data? HOT 20
- Steps to implement hindex to my hbase cluster HOT 6
- is there any new release based on hbase0.98.1+? HOT 3
- ERRORs in building with CDH5.1 HOT 10
- Indexing arbitrary column qualifier HOT 4
- Pending items in Arbitrary index feature
- Unify index details validation in preCreateTable and preModifyTable to allow proper indexes
- To determine the split threshold
- Perfomance about hindex in range search
- No compile document? HOT 3
- does hindex only support hbase 0.94.8?
- Your project Huawei-Hadoop hindex is using buggy third-party libraries [WARNING]
- 请求项目如何启动?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hindex.