从零搭建基于 AI GitHub 分析平台 (12) 批量生成总结并存储数据库

调整数据库，添加相关表

修改 prisma/schema.prisma:

model Project {
  id           String         @id @default(cuid())
  createdAt    DateTime       @default(now())
  updatedAt    DateTime       @updatedAt
  name         String
  githubURL    String
  deleteAt     DateTime?
  usersProject UsersProject[]
  commits      Commit[]
}

model Commit {
  id        String   @id @default(cuid())
  createdAt DateTime @default(now())
  updatedAt DateTime @updatedAt

  projectId String
  project   Project  @relation(fields: [projectId], references: [id])

  commitMessage      String
  commitHash         String
  commitAuthorName   String
  commitAuthorAvatar String
  commitDate         DateTime
  // ai summary
  summary             String
}

添加批量生成总结功能

修改 src/lib/github.ts

export const pollCommit = async (projectId: string) => {
  const { project, githubURL } = await fetchProjectGithubURL( projectId );
  const commitHashes = await getCommitHashes(githubURL);
  const unprocessedCommits = await filterUnprojcessedCommit( projectId, commitHashes );
  const summaryResponses = await Promise.allSettled( unprocessedCommits.map(commit => {
    return summariseCommit(githubURL, commit.commitHash)
  }));
  const summarises = summaryResponses.map((response) => {
    if (response.status === 'fulfilled'){
      return response.value as string
    }
    return ""
  })

  const commits = await db.commit.createMany({
    data: summarises.map((summary, index) =>{
      console.log(`processing commit ${index}`)
      return {
        projectId: projectId,
        commitHash : unprocessedCommits[index]!.commitHash,
        commitMessage: unprocessedCommits[index]!.commitMessage,
        commitAuthorName :unprocessedCommits[index]!.commitAuthorName,
        commitAuthorAvatar : unprocessedCommits[index]!.commitAuthorAvatar,
        commitDate :unprocessedCommits[index]!.commitDate,
        summary
      }
    })
  });

  return commits;
}

async function summariseCommit(githubURL: string, commitHash :string) {
  console.log(`${githubURL}/commit/${commitHash}.diff  start`);
  const { data } = await axios.get(`${githubURL}/commit/${commitHash}.diff` , {
    headers: {
      Accept: 'application/vnd.github.v3.diff'
    }
  });
  console.log(`${githubURL}/commit/${commitHash}.diff  Done`);
  return await aiSummariseCommit(data) || "";
}

async function fetchProjectGithubURL( projectId : string) {
  const project = await db.project.findUnique({
    where: { id: projectId},
    select: {
      githubURL:true
    }
  });
  if ( !project?.githubURL) {
    throw new Error("Project has no gitHub url");
  }

  return { project, githubURL: project.githubURL }
}

async function filterUnprojcessedCommit(projectId:string, commitHashes: Response[]) {
  const processedCommits = await db.commit.findMany({
    where: { projectId}
  });

  const unprocessedCommits = commitHashes.filter((commit) => !processedCommits.some((processedCommit) => processedCommit.commitHash === commit.commitHash))
  return unprocessedCommits;
}

添加项目时调用函数

修改 src/server/api/routers/project.ts:

createProject: authenticatedProcedure.input(
    z.object({
      name: z.string(),
      githubURL: z.string(),
      githubToken: z.string().optional(),
    })
  ).mutation(async ({ ctx , input })=>{ 
    const project = await ctx.db.project.create({
      data: {
        githubURL : input.githubURL,
        name: input.name,
        usersProject: {
          create: {
            userId: ctx.user.userId!,
          }
        }
      }
    });
    //调用函数
    await pollCommit(project.id);
    return project;
  }),

测试

启动程序，添加新项目，成功添加后，可以看到后台数据库有新的commits数据。

---

作者：Bearalise
出处：从零搭建基于 AI GitHub 分析平台 (12) 批量生成总结并存储数据库
版权：本文版权归作者所有
转载：欢迎转载，但未经作者同意，必须保留此段声明，必须在文章中给出原文链接。