Nearly thirty years old, established in science and technology

Chapter 78: Three-dimensional fusion architecture chips are on the agenda

Ji Hong's powerful words touched everyone's heartstrings, and he seemed to be ten years younger.

"Yes." Wen Chen thought for a long time, and finally said in a deep voice: "I will sum up today's things and report them to you. Ji Hong, you have a heavy responsibility, and I am optimistic about you!"

Mr. Ji, Professor Ji, you, Ji Hong...

In today's meeting, among the four ways Wen Chen called Ji Hong, Ji Hong liked the last one the most.

For an old man who is nearly sixty years old, this sentence carries a lot of weight. It is not a leader's advice to his subordinates, nor is it a request for partners. It is an old man's hope for the future and the next generation.

Ji Hong nodded solemnly: "Always remember the words of the elders and keep them in your heart."

……

At the end of the meeting, it was getting late. As soon as Ji Hong returned home, he saw Cheng Hui shouting: "My husband is so awesome!"

Yes, I originally wanted to ask about the specific situation of +1 this afternoon, but there is no need to ask - the scene in front of me has already explained everything.

"What are you looking at?" Ji Hong walked over and asked curiously.

"Look at the video. If it weren't for this UP owner, even I wouldn't know that training AI in other companies would be so troublesome!" Cheng Hui looked curious about the baby.

"Uh~" Ji Hong was stunned. He seemed to have never told Cheng Hui about this.

On my side, Cyber ​​Girl uses large models from other companies and optimization of the decision-making process of quasi-thinking. Personal work assistants and plug-ins all directly use quasi-thinking with certain decision-making capabilities. I have never trained one from scratch at home. Ordinary large model.

Why is the owner of UP so awesome? I must thank you when I find an opportunity. Ji Hong thought.

After taking the tablet and looking at it for a while, this idea became more intense - even Ji Hong couldn't help but laugh at many scenes in it - but think about it, this is normal. At the level of GPT2, what kind of trouble would it cause? None of the jokes are surprising.

In the early years, wasn't it still called artificial mental retardation? It was only after GPT3.5 that it gradually got better.

"There are people who want to popularize science about the difference between [human-like generalization ability] and [like-like thinking]." Seeing Ji Hong finish reading, Cheng Hui scrolled through the favorites a few more times and said, "No, that's it, but I saw a little bit. I’m so dizzy!”

“[Human-like generalization ability] is to train the model in changing task environments, so that the model gradually acquires the systematic reasoning ability to combine word meanings.”

Ji Hong was speechless. This popular science is not as good as that of Xia Fei just now. Who can understand it except professionals? He thought for a while and explained to Cheng Hui: "Actually, it's easy to understand. First of all, you have to know that people's What does generalization ability refer to? It is actually the ability to associate and draw inferences from one example.

"For machines, this is very difficult. How did Microsoft and OpenAI do this? Let's put it this way, if the original large model is a net, you have seen a net, just like a fishing net Likewise, one pimple is connected to several other pimples through several lines.

"It is difficult to directly connect the knots that are not connected to it. The artificial intelligence model is similar, so the model's associative ability is weak, and it is difficult to draw inferences from one example.

"But, we found that, hey, although these two things are far apart, they are actually the same thing, for example, Qin Shihuang and Ying Zheng. So we give them artificial standards in any environmental changes. .

"There are many similar situations, so just artificially mark them all. In this way, after a long period of training, the model will have the ability to associate two similar things together at all times.

"The language model itself is a network, and this is equivalent to weaving a new network in the original language model, a network within a network."

Having said this, Ji Hong also admired these people in his heart. Through artificial strong marking of connections, coupled with large-scale computing power, they actually trained a [Language Generalization Ability] similar to that of humans.

If you really have unlimited computing power, maybe you can actually come up with something bigger. However, the matter of unlimited computing power is just something to think about - even if all the sand in the world is made into chips and all the energy is used to generate electricity, no matter how large the amount is, there is still a certain amount.

"What about our quasi-thinking?" Cheng Hui asked.

“Quasi-thinking is not a comprehensive model, not just a language model.” Ji Hong said: “In fact, quasi-thinking is more biased towards the decision-making process.

"For formal documents, documentation, and technical information, class thinking is better at it. Whether it is a work assistant or a system automation plug-in, they are all based on this.

"But if you use a personal assistant, isn't the model's language ability weak? It can basically understand a normal conversation.

"Language ability is indeed one of the weaknesses of the current human-like thinking model, but even if it is a weakness, it is not the so-called MLC training method of [human-like generalization] - a method that relies on manual labeling and then accumulation of computing power. Nothing can be compared with anything you train for.”

"Of course my husband is the most powerful!" Cheng Hui's eyes started to sparkle again.

[Being recognized, people’s generalization ability forms a mechanism for thinking inspiration +1]

"Buzz!" Ji Hong's mind exploded instantly - not because of the amount of inspiration, but because this mechanism seems to involve another level - the study of the formation mechanism of human generalization ability seems to be the human brain itself.

Not only that, it seems to be able to be combined with the [thinking inspiration of how to achieve human-like generalization ability] obtained during the afternoon meeting!
But if you think about it carefully, this is very reasonable. One is the formation mechanism of people's own generalization ability, and the other is imitation. Human-like generalization ability - you can see it just from the name.

"We are all alive now." Ji Hong sighed in his heart, and even more excitedly hugged Cheng Hui and spun him around several times.

"Ah!" Cheng Hui even screamed, and then shouted: "Put me down, what's wrong? You are thirty years old today, and you are not afraid of flashing your waist?"

"It's okay!" Ji Hong let Cheng Hui down and patted a few of his abdominal muscles: "You're strong!"

Not to mention, the effect during this period is really obvious. The last time I played like this was in college.

"Look!" Cheng Hui chuckled, "You won't be busy until late today, right?"

"No!" Ji Hong said: "I explained some things during the meeting. I will go over and sort them out. It will never be too late. It will be done before ten o'clock!"

I only recorded a rough outline of my inspiration ideas in the afternoon. It was like a ghostly drawing that only Ji Hong could understand today. He might be blinded tomorrow.

The inspiration he had just obtained also needed to be organized and recorded - Ji Hong told Cheng Hui and immediately moved to the study.

"Human-like generalization ability, the formation mechanism of human generalization ability, these two..."

While Ji Hong was sorting out his thoughts, he was still thinking - this seems to have something in common with the previous quasi-thinking. Can it be combined?

The connection between the two things kept popping up in his mind, and as he kept writing and drawing, Ji Hong finally came to the conclusion: "In this case, it seems that new hardware support is needed...

"Storage and computing three-dimensional fusion architecture chip?" Ji Hong instantly thought of the inspiration he got last time, and quickly dug out the records at that time. After a comparison, he found that it was indeed the case!
There is a connection between these three!

Ji Hong's mind was opened instantly, and the source of inspiration was like a torrent that broke the dam, and then it got out of hand and could no longer be resisted!
Chips, algorithms, models...the three are just organically combined, and the entire chain is connected in an instant!

"Well, the three-dimensional fusion architecture chip must be put on the agenda!" Ji Hong nodded, thinking about this.

　I will publish two chapters of 5,000 words first, and I should be able to write another chapter when I get back, but it will be later!
　　
　
(End of this chapter)