hadoop security No groups available

  • other
  • 7月 14, 2015
  • 0 评论

【摘要】Hadoop NameNode 日志疯狂滚动,每天80G以上,日志中全是类似WARN org.apache.hadoop.security.UserGroupInformation: No groups available for user xxx的报错,说明一下,任务是通过hive提交的。

google了大半天,没有建设性的意见,最后发现了这个链接中有这样一段话:
http://hakunamapdata.com/a-user-having-surprising-troubles-running-more-resource-intensive-hive-queries/

Possible fixes

How this problem could be solved? Obviously, a quick and dirty solution is to create an account on NameNode server for each user who accessing HDFS (directly, or by submitting MapReduce jobs to the cluster). However, for many reasons, you do not want to give everybody an account on NameNode server.

2015-07-14 10:44:23,989 WARN org.apache.hadoop.security.UserGroupInformation: No groups available for user sudops
2015-07-14 10:44:23,991 WARN org.apache.hadoop.security.ShellBasedUnixGroupsMapping: got exception trying to get groups for user sudops
org.apache.hadoop.util.Shell$ExitCodeException: id: sudops:无此用户

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
	at org.apache.hadoop.util.Shell.run(Shell.java:182)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
	at org.apache.hadoop.util.Shell.execCommand(Shell.java:461)
	at org.apache.hadoop.util.Shell.execCommand(Shell.java:444)
	at org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:68)
	at org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:45)
	at org.apache.hadoop.security.Groups.getGroups(Groups.java:79)
	at org.apache.hadoop.security.UserGroupInformation.getGroupNames(UserGroupInformation.java:1054)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.<init>(FSPermissionChecker.java:50)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5464)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkTraverse(FSNamesystem.java:5447)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:2168)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.getFileInfo(NameNode.java:888)
	at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:578)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1393)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1389)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1387)

u2

Related Posts

  • other
  • 5月 29, 2026
  • 201 views
纳斯达克指数创历史新高–全球资本对科技产业未来的重新定价!

纳指26,656点的新高,是AI产业周期、资金面支撑、地缘风险缓和三重因素共振的结果。这轮牛市的核心逻辑是”AI从概念走向营收”,而非简单的流动性驱动。

但历史告诉我们,没有任何指数能永远上涨。当前的技术超买、估值偏高、市场背离等信号,都在提醒投资者:参与盛宴的同时,别忘了系好安全带。

Read more

提供免费IP查询接口,Json格式返回方便程序调用

本站提供IP查询接口,IP数据来源于APNIC.net,并结合GeoIP和纯真IP库整理而成,查询结果包含国家、省份/城市、运营商、经纬度、IP范围、归属地等;另外为方便在程序中调用特提供了接口调用,返回Json格式;本机接口完全免费,欢迎使用!

Read more

You Missed

Google 用 AI「杀死」Google

  • u2
  • 6月 22, 2026
  • 20 views

封禁Fable 5:当美国政府成为AI的”守门人”

  • u2
  • 6月 21, 2026
  • 30 views

27亿美元没留住的人,奥特曼等了十年

  • u2
  • 6月 19, 2026
  • 37 views

OpenAI Codex 发布角色插件:当AI开始理解「分析师」和「销售」是两种不同的物种

  • u2
  • 6月 15, 2026
  • 70 views
OpenAI Codex 发布角色插件:当AI开始理解「分析师」和「销售」是两种不同的物种

TraceClaw:企业级透明可控智能体,全行为审计+零信任执行

  • u2
  • 6月 13, 2026
  • 60 views

一年前让英伟达蒸发6000亿美元的中国AI,现在被黄仁勋请上了CES的PPT

  • u2
  • 6月 7, 2026
  • 97 views